[ 544.518509] env[65421]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 544.518509] env[65421]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 545.516140] env[65511]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 545.516140] env[65511]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 547.071088] env[65511]: INFO neutron.common.config [-] Logging enabled! [ 547.071539] env[65511]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev39 [ 547.071611] env[65511]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65511) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 547.071887] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 547.071983] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 547.072845] env[65511]: WARNING oslo_policy.policy [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.073062] env[65511]: WARNING oslo_policy.policy [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 547.074703] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] VMware NSXv3 Agent initialized successfully. [ 547.075063] env[65511]: DEBUG oslo_concurrency.lockutils [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Acquiring lock "singleton_lock" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.075189] env[65511]: DEBUG oslo_concurrency.lockutils [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Acquired lock "singleton_lock" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.075385] env[65511]: DEBUG oslo_concurrency.lockutils [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Releasing lock "singleton_lock" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.075674] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Full set of CONF: {{(pid=65511) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 547.075784] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ******************************************************************************** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 547.075881] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Configuration options gathered from: {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 547.076226] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 547.076390] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 547.076491] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ================================================================================ {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 547.076652] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] agent_down_time = 75 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.076788] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] allow_automatic_dhcp_failover = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.076916] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] allow_bulk = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077064] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] api_extensions_path = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077198] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] api_paste_config = api-paste.ini {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077331] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] auth_strategy = keystone {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077430] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] backdoor_port = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077526] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] backdoor_socket = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077655] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] backlog = 4096 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077786] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] base_mac = fa:16:3e:00:00:00 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.077935] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] bind_host = 0.0.0.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078080] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] bind_port = 9696 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078208] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] client_socket_timeout = 900 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078340] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] config_dir = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078443] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078572] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] config_source = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078705] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] control_exchange = neutron {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078836] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] core_plugin = ml2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.078970] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] debug = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.079192] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] default_availability_zones = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.079527] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.079762] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dhcp_agent_notification = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.079988] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dhcp_agents_per_network = 1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080223] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dhcp_lease_duration = 86400 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080390] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dhcp_load_type = networks {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080533] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dns_domain = openstacklocal {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080669] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080803] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_default_route_bfd = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.080930] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_default_route_ecmp = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081072] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_dvr = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081202] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_new_agents = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081328] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081454] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_signals = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081579] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] enable_traditional_dhcp = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081701] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] external_dns_driver = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081824] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] filter_validation = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.081959] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] global_physnet_mtu = 8950 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082098] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] graceful_shutdown_timeout = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082267] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] host = cpu-1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082400] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] host_dvr_for_dhcp = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082527] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] http_retries = 3 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082687] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] instance_format = [instance: %(uuid)s] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082826] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.082957] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ipam_driver = internal {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083095] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ipv6_pd_enabled = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083220] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] l3_ha = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083349] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083476] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] l3_ha_network_physical_name = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083603] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] l3_ha_network_type = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083738] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_color = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083866] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_config_append = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.083996] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084132] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_dir = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084256] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_file = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084352] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_options = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084480] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_rotate_interval = 1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084612] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_rotate_interval_type = days {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084743] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] log_rotation_type = none {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084843] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.084940] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085082] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085215] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085312] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085439] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_dns_nameservers = 5 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085564] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_header_line = 16384 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085691] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_l3_agents_per_router = 3 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085811] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_logfile_count = 30 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.085930] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_logfile_size_mb = 200 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086063] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] max_subnet_host_routes = 20 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086194] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] my_ip = 10.180.1.21 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086322] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] my_ipv6 = ::1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086445] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] network_auto_schedule = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086565] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] network_link_prefix = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086696] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086825] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] notify_nova_on_port_data_changes = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.086953] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] notify_nova_on_port_status_changes = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087093] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] pagination_max_limit = -1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087218] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] publish_errors = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087343] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rate_limit_burst = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087473] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rate_limit_except_level = CRITICAL {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087600] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rate_limit_interval = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087725] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] retry_until_window = 30 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087850] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] router_distributed = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.087976] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rpc_resources_processing_step = 20 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088112] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rpc_response_max_timeout = 600 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088237] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] rpc_response_timeout = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088358] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] send_events_interval = 2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088498] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] service_plugins = ['router'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088630] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] setproctitle = on {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088753] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] shell_completion = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.088880] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] state_path = /opt/stack/data/neutron {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089028] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] syslog_log_facility = LOG_USER {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089153] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] tcp_keepidle = 600 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089283] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] transport_url = **** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089407] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] use_journal = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089529] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] use_json = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089649] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] use_ssl = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089769] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] use_stderr = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.089897] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] use_syslog = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090030] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vlan_qinq = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090152] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vlan_transparent = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090274] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] watch_log_file = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090395] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] wsgi_default_pool_size = 100 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090540] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] wsgi_keep_alive = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090689] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090818] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] wsgi_server_debug = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 547.090960] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_concurrency.disable_process_locking = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091111] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091248] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091376] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091507] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091638] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091769] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.091909] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.connection_string = messaging:// {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092054] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.enabled = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092189] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.es_doc_type = notification {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092315] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.es_scroll_size = 10000 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092444] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.es_scroll_time = 2m {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092593] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.filter_error_trace = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092724] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.hmac_keys = **** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092861] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.sentinel_service_name = mymaster {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.092998] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.socket_timeout = 0.1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093141] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.trace_requests = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093267] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler.trace_sqlalchemy = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093407] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler_jaeger.process_tags = {} {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093539] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler_jaeger.service_name_prefix = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093660] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] profiler_otlp.service_name_prefix = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.093800] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.enforce_new_defaults = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094069] env[65511]: WARNING oslo_config.cfg [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 547.094217] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.enforce_scope = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094355] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.policy_default_rule = default {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094496] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094631] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094765] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.094892] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095024] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095151] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095276] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095406] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_policy.remote_timeout = 60.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095546] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095684] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] agent.extensions = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095817] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.095948] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] service_providers.service_provider = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096094] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.default_quota = -1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096231] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096357] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_floatingip = 50 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096482] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_network = 100 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096605] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_port = 500 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096729] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096854] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_router = 10 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.096978] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_security_group = 10 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097117] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097241] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.quota_subnet = 100 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097365] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] QUOTAS.track_quota_usage = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097501] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097623] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097744] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097869] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.097998] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098140] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098263] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098397] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098521] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098642] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098767] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.098894] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099028] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099154] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_dhcp_release.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099285] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099405] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099525] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099649] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099776] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.099904] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100040] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_ovs_vsctl.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100173] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.capabilities = [21] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100295] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100422] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100574] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100711] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100841] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.100965] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_namespace.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101113] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.capabilities = [12] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101241] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101364] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101491] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101621] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101749] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.101875] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_conntrack.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102019] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.capabilities = [12, 21] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102149] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.group = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102270] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.helper_command = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102397] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.log_daemon_traceback = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102525] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102674] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.thread_pool_size = 8 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102805] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] privsep_link.user = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.102951] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103106] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103241] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.continue_on_failed_promotions = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103366] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.dscp = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103497] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.dscp_inherit = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103636] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.force_mp_to_policy = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103764] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.locking_coordinator_url = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.103893] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.log_agent_heartbeats = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104034] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.logging_expire = 1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104172] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104302] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104438] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.polling_interval = 240 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104567] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104702] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.104839] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.report_interval = 30.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105021] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105159] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105300] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105432] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.sync_skew = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105564] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.synchronization_queue_size = 20 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105696] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT.use_helper_for_ns_read = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105832] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] SECURITYGROUP.enable_ipset = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.105967] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] SECURITYGROUP.enable_security_group = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106115] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106253] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106388] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] experimental.ipv6_pd_enabled = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106539] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.extension_drivers = ['port_security'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106670] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.external_network_type = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106814] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.106952] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.overlay_ip_version = 4 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107099] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.path_mtu = 8950 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107236] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.physical_network_mtus = {} {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107376] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.tenant_network_types = ['vlan'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107512] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107648] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ml2.type_drivers = ['vlan'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107885] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT_CLI.neutron_port_id = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.107924] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108039] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108181] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108320] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108453] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108589] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108725] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.108857] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109049] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109194] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_login_password = **** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109332] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_login_port = 443 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109464] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_login_user = admin {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109598] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109736] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109866] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.109993] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110144] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110281] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110414] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110576] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110719] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110856] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.110996] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111181] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111332] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111512] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111652] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vsphere.vsphere_login_password = VMware1! {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111789] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.111919] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112063] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.auth_section = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112205] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.auth_type = password {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112372] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112460] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.certfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112604] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.collect_timing = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112750] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.endpoint_type = public {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.112878] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.insecure = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113012] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.keyfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113147] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.region_name = RegionOne {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113273] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.split_loggers = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113394] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] nova.timeout = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113522] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.auth_section = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113660] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.auth_type = password {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113793] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.113916] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.certfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114055] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.collect_timing = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114193] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.endpoint_type = public {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114319] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.insecure = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114442] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.keyfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114564] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.region_name = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114689] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.split_loggers = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114809] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] placement.timeout = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.114962] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.auth_section = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115109] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.auth_type = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115233] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.cafile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115355] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.certfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115480] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.collect_timing = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115605] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.connect_retries = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115729] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.connect_retry_delay = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115854] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.enable_notifications = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.115973] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.endpoint_override = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116110] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.insecure = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116232] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.interface = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116354] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.keyfile = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116480] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.max_version = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116600] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.min_version = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116722] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.region_name = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116844] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.retriable_status_codes = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.116968] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.service_name = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117099] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.service_type = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117223] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.split_loggers = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117343] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.status_code_retries = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117462] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.status_code_retry_delay = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117582] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.timeout = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117702] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.valid_interfaces = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117824] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ironic.version = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.117955] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] cli_script.dry_run = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118107] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118234] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118361] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118486] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118672] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118723] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.118851] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119021] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119115] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119250] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119376] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119507] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119639] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119769] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.119895] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120037] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120165] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120292] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120424] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120579] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120711] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120841] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.120969] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121108] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121236] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121361] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121488] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121617] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121746] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121879] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.121995] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122142] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122276] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122404] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122534] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122690] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.ssl_version = {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.122822] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.123016] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_notifications.driver = [] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.123115] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_notifications.retry = -1 {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.123312] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.123449] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] oslo_messaging_notifications.transport_url = **** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 547.123570] env[65511]: DEBUG oslo_service.backend._eventlet.service [None req-a2082f2e-36b4-419f-9a35-59fad5c3b2de None None] ******************************************************************************** {{(pid=65511) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 547.124673] env[65511]: DEBUG neutron.agent.securitygroups_rpc [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Init firewall settings (driver=nsxv3) {{(pid=65511) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 547.126016] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65511) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 547.126255] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] RPC agent_id: nsxm-l-01a.corp.local [ 547.128444] env[65511]: DEBUG dogpile.cache.region [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 547.128563] env[65511]: DEBUG dogpile.lock [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 547.128657] env[65511]: DEBUG dogpile.lock [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 547.128743] env[65511]: DEBUG dogpile.lock [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 547.128833] env[65511]: DEBUG dogpile.cache.region [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 547.128916] env[65511]: DEBUG dogpile.lock [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 547.129046] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 547.186900] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Session token - acquiring [ 547.188623] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.188806] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.188893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.189357] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.200660] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.479620] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 547.500608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 547.500882] env[65511]: DEBUG dogpile.cache.region [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Cache value generated in 0.372 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 547.501080] env[65511]: DEBUG dogpile.lock [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 547.501219] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Activating Policy API Provider. [ 547.501424] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Looking for the default Infrastructure Rules. [ 547.572691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Looking for the Default Layer3 Logged Drop Section. [ 547.589457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 547.590025] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.590194] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.590292] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.590583] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.590914] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.105121] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.607175] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.109350] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Inventory metadata is going to be refreshed. [ 549.109853] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.942902] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.943178] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.943290] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.943501] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.958057] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.958057] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.958057] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.976577] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.977162] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.977485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.978070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.978402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.978718] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.978997] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.979303] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 550.000553] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.001053] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.001268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.001673] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.001980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.002241] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.023222] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.023806] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.024117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.024626] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.026231] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.026231] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.047020] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.047020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.047020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.047020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.047020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.047020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 550.047020] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.047020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 550.063119] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.063579] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.065904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.065904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.065904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.065904] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 550.065904] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.065904] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 550.086021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.086021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.086021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.086021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.086021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.086021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 550.086021] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.086021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Inventory metadata have been refreshed. [ 550.086021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Dryrun:True. Metadata refresh completed. [ 550.086021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Releasing lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.087373] env[65511]: INFO neutron.agent.agent_extensions_manager [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Loaded agent extensions: [] [ 550.088200] env[65511]: DEBUG neutron_lib.callbacks.manager [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65511) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 550.137041] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent RPC Daemon Started! [ 550.137041] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:0 started [ 550.137041] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent out of sync with plugin! [ 555.088907] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.088907] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.090779] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.091249] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.090210] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c391fe38-f24a-4811-aa76-1575215baa0d demo admin] Enqueued Resource ID: 22de2eb9-eef0-4d67-acd3-c833e3c9c405 with Priority: HIGHEST for action security_group_rules [ 565.090733] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22de2eb9-eef0-4d67-acd3-c833e3c9c405 with Priority: HIGHEST for action security_group_rules [ 565.091050] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22de2eb9-eef0-4d67-acd3-c833e3c9c405 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.091182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22de2eb9-eef0-4d67-acd3-c833e3c9c405" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.091254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22de2eb9-eef0-4d67-acd3-c833e3c9c405" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.091597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22de2eb9-eef0-4d67-acd3-c833e3c9c405" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.091681] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22de2eb9-eef0-4d67-acd3-c833e3c9c405',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.612739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.612981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.612981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.613207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.613268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.613365] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22de2eb9-eef0-4d67-acd3-c833e3c9c405 already deleted. [ 565.613450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22de2eb9-eef0-4d67-acd3-c833e3c9c405" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.091912] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.092331] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.091527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.091827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.091827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.092039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.092293] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.594503] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.096924] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.599169] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 572.599387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 573.386963] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.387438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.387438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.387515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.398169] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 573.398964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.399837] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 573.416655] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.416898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.416898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.417062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.417152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.417257] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 573.417325] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.417394] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 573.436090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.436251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.436285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.436477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.436611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.436713] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 573.454700] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.454880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.454925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.455113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.455220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.455329] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 573.472544] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.472737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.472737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.472910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.473051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.473166] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 573.473239] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.473308] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 573.489641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.489831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.489831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.490036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.490128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.490228] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 573.490299] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.490369] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 573.510370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.510598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.510598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.510769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.510874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.511026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 573.511114] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 573.511184] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 573.511250] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 573.511325] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 573.511386] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 573.511448] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 573.511708] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 573.511773] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 573.511842] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 573.530651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.530868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.530868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.531108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.531234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.531342] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 573.551901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.552145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.552145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.552298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.552399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.580664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.093808] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.094060] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.095080] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.095514] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 585.096902] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.096902] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 589.842927] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6d89fa33-f698-436e-b598-8e19ffdb540d None None] Enqueued Resource ID: deea3864-2ef7-4de3-a0ec-c453cdacaae8 with Priority: HIGHEST for action port [ 589.843219] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deea3864-2ef7-4de3-a0ec-c453cdacaae8 with Priority: HIGHEST for action port [ 589.843924] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-deea3864-2ef7-4de3-a0ec-c453cdacaae8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.843924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deea3864-2ef7-4de3-a0ec-c453cdacaae8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.843924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deea3864-2ef7-4de3-a0ec-c453cdacaae8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.844108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deea3864-2ef7-4de3-a0ec-c453cdacaae8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.844108] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deea3864-2ef7-4de3-a0ec-c453cdacaae8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.349748] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deea3864-2ef7-4de3-a0ec-c453cdacaae8 [ 590.349748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.349748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.349748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.349748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.349748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.349748] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deea3864-2ef7-4de3-a0ec-c453cdacaae8 already deleted. [ 590.349748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deea3864-2ef7-4de3-a0ec-c453cdacaae8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.500789] env[65511]: INFO networking_nsxv3.common.synchronization [None req-df239f4d-65a7-442b-b7e4-da216cd6d10f None None] Enqueued Resource ID: b4984247-ee05-431e-96ad-e7f156ff562c with Priority: HIGHEST for action port [ 591.501044] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4984247-ee05-431e-96ad-e7f156ff562c with Priority: HIGHEST for action port [ 591.501539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4984247-ee05-431e-96ad-e7f156ff562c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.501651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4984247-ee05-431e-96ad-e7f156ff562c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.501726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4984247-ee05-431e-96ad-e7f156ff562c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.501976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4984247-ee05-431e-96ad-e7f156ff562c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.502604] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4984247-ee05-431e-96ad-e7f156ff562c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.005629] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4984247-ee05-431e-96ad-e7f156ff562c [ 592.005811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.005947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.006027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.006252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.006345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.006440] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4984247-ee05-431e-96ad-e7f156ff562c already deleted. [ 592.006518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4984247-ee05-431e-96ad-e7f156ff562c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.365825] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e7a96845-b979-433e-b004-e7546f492da7 None None] Enqueued Resource ID: d128be4c-d106-4711-b03f-75fe1744766c with Priority: HIGHEST for action port [ 594.366089] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d128be4c-d106-4711-b03f-75fe1744766c with Priority: HIGHEST for action port [ 594.366823] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d128be4c-d106-4711-b03f-75fe1744766c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.366946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d128be4c-d106-4711-b03f-75fe1744766c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.367413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d128be4c-d106-4711-b03f-75fe1744766c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.368035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d128be4c-d106-4711-b03f-75fe1744766c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.368255] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d128be4c-d106-4711-b03f-75fe1744766c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.617633] env[65511]: INFO networking_nsxv3.common.synchronization [None req-68763714-d654-4ce8-b4c2-cb9f90203bf7 None None] Enqueued Resource ID: e514e479-025c-42e4-9eb6-59996330da1a with Priority: HIGHEST for action port [ 594.617816] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e514e479-025c-42e4-9eb6-59996330da1a with Priority: HIGHEST for action port [ 594.618089] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e514e479-025c-42e4-9eb6-59996330da1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.618287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e514e479-025c-42e4-9eb6-59996330da1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.618287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e514e479-025c-42e4-9eb6-59996330da1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.618536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e514e479-025c-42e4-9eb6-59996330da1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.618632] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e514e479-025c-42e4-9eb6-59996330da1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.870788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d128be4c-d106-4711-b03f-75fe1744766c [ 594.871043] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.871181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.871251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.871499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.871595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.871691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d128be4c-d106-4711-b03f-75fe1744766c already deleted. [ 594.871767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d128be4c-d106-4711-b03f-75fe1744766c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.122267] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e514e479-025c-42e4-9eb6-59996330da1a [ 595.122267] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.122267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.122267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.122267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.122267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.122267] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e514e479-025c-42e4-9eb6-59996330da1a already deleted. [ 595.122267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e514e479-025c-42e4-9eb6-59996330da1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.844082] env[65511]: INFO networking_nsxv3.common.synchronization [None req-09851169-b010-4e42-94ec-1901eb835a60 None None] Enqueued Resource ID: 8b3793ad-e713-4149-9468-bc827cf07f60 with Priority: HIGHEST for action port [ 596.845009] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3793ad-e713-4149-9468-bc827cf07f60 with Priority: HIGHEST for action port [ 596.845009] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3793ad-e713-4149-9468-bc827cf07f60 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.845138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3793ad-e713-4149-9468-bc827cf07f60" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.845190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3793ad-e713-4149-9468-bc827cf07f60" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.845444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3793ad-e713-4149-9468-bc827cf07f60" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.845529] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3793ad-e713-4149-9468-bc827cf07f60',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.347403] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b3793ad-e713-4149-9468-bc827cf07f60 [ 597.347640] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.347778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.347848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.348199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.348199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.348314] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b3793ad-e713-4149-9468-bc827cf07f60 already deleted. [ 597.348351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3793ad-e713-4149-9468-bc827cf07f60" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.432423] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1c5aa64b-c4c8-42ac-a9c1-7c07f8b59f48 None None] Enqueued Resource ID: b577dc7a-6bf7-4d60-81b9-ab16121bac4d with Priority: HIGHEST for action port [ 597.432975] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b577dc7a-6bf7-4d60-81b9-ab16121bac4d with Priority: HIGHEST for action port [ 597.433614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b577dc7a-6bf7-4d60-81b9-ab16121bac4d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.433890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b577dc7a-6bf7-4d60-81b9-ab16121bac4d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.433970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b577dc7a-6bf7-4d60-81b9-ab16121bac4d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.434220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b577dc7a-6bf7-4d60-81b9-ab16121bac4d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.434308] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b577dc7a-6bf7-4d60-81b9-ab16121bac4d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.937045] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b577dc7a-6bf7-4d60-81b9-ab16121bac4d [ 597.938712] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.938712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.938712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.938712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.938712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.938712] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b577dc7a-6bf7-4d60-81b9-ab16121bac4d already deleted. [ 597.938712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b577dc7a-6bf7-4d60-81b9-ab16121bac4d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.631260] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6ab44a84-1ea2-49f1-bce7-a14515c3e4bc None None] Enqueued Resource ID: 5449b227-794b-4d99-9151-3821a446907b with Priority: HIGHEST for action port [ 599.631676] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5449b227-794b-4d99-9151-3821a446907b with Priority: HIGHEST for action port [ 599.632021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5449b227-794b-4d99-9151-3821a446907b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.632180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5449b227-794b-4d99-9151-3821a446907b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.632214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5449b227-794b-4d99-9151-3821a446907b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.632455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5449b227-794b-4d99-9151-3821a446907b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.633075] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5449b227-794b-4d99-9151-3821a446907b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.126285] env[65511]: INFO networking_nsxv3.common.synchronization [None req-94f12c07-4ee5-4866-a927-4dd436d2272e None None] Enqueued Resource ID: b4242c36-6788-47b4-95d5-13aef4775ef4 with Priority: HIGHEST for action port [ 600.126896] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4242c36-6788-47b4-95d5-13aef4775ef4 with Priority: HIGHEST for action port [ 600.127214] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4242c36-6788-47b4-95d5-13aef4775ef4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.127341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4242c36-6788-47b4-95d5-13aef4775ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.127407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4242c36-6788-47b4-95d5-13aef4775ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.127667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4242c36-6788-47b4-95d5-13aef4775ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.127750] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4242c36-6788-47b4-95d5-13aef4775ef4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.138073] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5449b227-794b-4d99-9151-3821a446907b [ 600.138073] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.138073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.138073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.138235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.138321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.138400] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5449b227-794b-4d99-9151-3821a446907b already deleted. [ 600.138476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5449b227-794b-4d99-9151-3821a446907b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.573790] env[65511]: INFO networking_nsxv3.common.synchronization [None req-34c46cc1-9203-43cd-b7bb-31b8c071a6d3 None None] Enqueued Resource ID: 1736fce3-c358-4559-a597-ff6a7f8e765d with Priority: HIGHEST for action port [ 600.574178] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1736fce3-c358-4559-a597-ff6a7f8e765d with Priority: HIGHEST for action port [ 600.574522] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1736fce3-c358-4559-a597-ff6a7f8e765d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.574680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1736fce3-c358-4559-a597-ff6a7f8e765d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.574986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1736fce3-c358-4559-a597-ff6a7f8e765d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.575128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1736fce3-c358-4559-a597-ff6a7f8e765d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.575128] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1736fce3-c358-4559-a597-ff6a7f8e765d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.631852] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4242c36-6788-47b4-95d5-13aef4775ef4 [ 600.632124] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.632504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.632578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.633148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.633325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.633517] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4242c36-6788-47b4-95d5-13aef4775ef4 already deleted. [ 600.633709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4242c36-6788-47b4-95d5-13aef4775ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.004621] env[65511]: INFO networking_nsxv3.common.synchronization [None req-4b431f87-d129-4bd1-a370-921ce7bd2eb6 None None] Enqueued Resource ID: a452ee88-502b-4eb2-ae75-db9427fe5b82 with Priority: HIGHEST for action port [ 601.005626] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a452ee88-502b-4eb2-ae75-db9427fe5b82 with Priority: HIGHEST for action port [ 601.005626] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-a452ee88-502b-4eb2-ae75-db9427fe5b82 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.005626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a452ee88-502b-4eb2-ae75-db9427fe5b82" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.005752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a452ee88-502b-4eb2-ae75-db9427fe5b82" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.008308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a452ee88-502b-4eb2-ae75-db9427fe5b82" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.008517] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a452ee88-502b-4eb2-ae75-db9427fe5b82',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.076825] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1736fce3-c358-4559-a597-ff6a7f8e765d [ 601.077060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.077193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.077264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.077480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.077564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077710] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1736fce3-c358-4559-a597-ff6a7f8e765d already deleted. [ 601.077794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1736fce3-c358-4559-a597-ff6a7f8e765d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.513991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a452ee88-502b-4eb2-ae75-db9427fe5b82 [ 601.514334] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.514514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.514963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.515757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.515961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.516100] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a452ee88-502b-4eb2-ae75-db9427fe5b82 already deleted. [ 601.516197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a452ee88-502b-4eb2-ae75-db9427fe5b82" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.916198] env[65511]: INFO networking_nsxv3.common.synchronization [None req-739432e6-cbca-4452-8b53-8a577cd3a27f None None] Enqueued Resource ID: 93ef9625-38ac-4a3c-897d-5b0143495c9a with Priority: HIGHEST for action port [ 601.916759] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ef9625-38ac-4a3c-897d-5b0143495c9a with Priority: HIGHEST for action port [ 601.917106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-93ef9625-38ac-4a3c-897d-5b0143495c9a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.917299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93ef9625-38ac-4a3c-897d-5b0143495c9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.917397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93ef9625-38ac-4a3c-897d-5b0143495c9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.917910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93ef9625-38ac-4a3c-897d-5b0143495c9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.917910] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93ef9625-38ac-4a3c-897d-5b0143495c9a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.420593] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93ef9625-38ac-4a3c-897d-5b0143495c9a [ 602.420593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.420910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.420910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.421022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.421082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.421185] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93ef9625-38ac-4a3c-897d-5b0143495c9a already deleted. [ 602.421292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93ef9625-38ac-4a3c-897d-5b0143495c9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.471160] env[65511]: INFO networking_nsxv3.common.synchronization [None req-3b93bdab-6712-439a-891b-edfe4d9c2df6 None None] Enqueued Resource ID: 2c2688d8-dcd9-4dfa-aa83-32d2fae20350 with Priority: HIGHEST for action port [ 602.472427] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2688d8-dcd9-4dfa-aa83-32d2fae20350 with Priority: HIGHEST for action port [ 602.472758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c2688d8-dcd9-4dfa-aa83-32d2fae20350 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.472916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c2688d8-dcd9-4dfa-aa83-32d2fae20350" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.474122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c2688d8-dcd9-4dfa-aa83-32d2fae20350" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.474122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c2688d8-dcd9-4dfa-aa83-32d2fae20350" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.474122] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2688d8-dcd9-4dfa-aa83-32d2fae20350',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.976764] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c2688d8-dcd9-4dfa-aa83-32d2fae20350 [ 602.976764] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.977429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.977429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.977429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.977429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.977429] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c2688d8-dcd9-4dfa-aa83-32d2fae20350 already deleted. [ 602.977638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c2688d8-dcd9-4dfa-aa83-32d2fae20350" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.280975] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ed77b686-1397-4940-ab41-0e239b7c039f None None] Enqueued Resource ID: 385241e0-991a-41b0-8e7c-69b25227a0d7 with Priority: HIGHEST for action port [ 603.281245] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 385241e0-991a-41b0-8e7c-69b25227a0d7 with Priority: HIGHEST for action port [ 603.281805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-385241e0-991a-41b0-8e7c-69b25227a0d7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.281924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-385241e0-991a-41b0-8e7c-69b25227a0d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.281994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-385241e0-991a-41b0-8e7c-69b25227a0d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.282702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-385241e0-991a-41b0-8e7c-69b25227a0d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.282953] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('385241e0-991a-41b0-8e7c-69b25227a0d7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.786222] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 385241e0-991a-41b0-8e7c-69b25227a0d7 [ 603.786579] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.786739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.786804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.787048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.787139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.787349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:385241e0-991a-41b0-8e7c-69b25227a0d7 already deleted. [ 603.787349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-385241e0-991a-41b0-8e7c-69b25227a0d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.952994] env[65511]: INFO networking_nsxv3.common.synchronization [None req-7c128dbf-ce67-4e63-86bd-0584b412b6c3 None None] Enqueued Resource ID: 1b245b01-d3a6-4227-a9f5-a8fe9196cc69 with Priority: HIGHEST for action port [ 603.953930] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b245b01-d3a6-4227-a9f5-a8fe9196cc69 with Priority: HIGHEST for action port [ 603.953930] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b245b01-d3a6-4227-a9f5-a8fe9196cc69 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.954100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b245b01-d3a6-4227-a9f5-a8fe9196cc69" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.954100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b245b01-d3a6-4227-a9f5-a8fe9196cc69" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.954262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b245b01-d3a6-4227-a9f5-a8fe9196cc69" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.954348] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b245b01-d3a6-4227-a9f5-a8fe9196cc69',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.119130] env[65511]: INFO networking_nsxv3.common.synchronization [None req-55cf27a2-1ec7-449b-bc5c-13274ea5004f None None] Enqueued Resource ID: 171acb67-afff-40b7-aeb2-73a868886c8b with Priority: HIGHEST for action port [ 604.119130] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171acb67-afff-40b7-aeb2-73a868886c8b with Priority: HIGHEST for action port [ 604.119130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-171acb67-afff-40b7-aeb2-73a868886c8b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.119130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-171acb67-afff-40b7-aeb2-73a868886c8b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.119130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-171acb67-afff-40b7-aeb2-73a868886c8b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.119130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-171acb67-afff-40b7-aeb2-73a868886c8b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.119130] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('171acb67-afff-40b7-aeb2-73a868886c8b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.458709] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b245b01-d3a6-4227-a9f5-a8fe9196cc69 [ 604.458709] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.458709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.458709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.459053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.459220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.459293] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b245b01-d3a6-4227-a9f5-a8fe9196cc69 already deleted. [ 604.459423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b245b01-d3a6-4227-a9f5-a8fe9196cc69" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.621070] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 171acb67-afff-40b7-aeb2-73a868886c8b [ 604.621396] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.621615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.621767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.622054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.622186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.622374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:171acb67-afff-40b7-aeb2-73a868886c8b already deleted. [ 604.622508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-171acb67-afff-40b7-aeb2-73a868886c8b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.406686] env[65511]: INFO networking_nsxv3.common.synchronization [None req-535a873e-397c-4ed6-a84a-1ebd1f73cb2a None None] Enqueued Resource ID: d01babde-e3ee-470f-b582-4c18702d570c with Priority: HIGHEST for action port [ 605.406952] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d01babde-e3ee-470f-b582-4c18702d570c with Priority: HIGHEST for action port [ 605.407890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d01babde-e3ee-470f-b582-4c18702d570c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.407890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d01babde-e3ee-470f-b582-4c18702d570c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.407890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d01babde-e3ee-470f-b582-4c18702d570c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.407890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d01babde-e3ee-470f-b582-4c18702d570c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.408277] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d01babde-e3ee-470f-b582-4c18702d570c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.911343] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d01babde-e3ee-470f-b582-4c18702d570c [ 605.912189] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.912189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.912189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.912189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.912189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.912189] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d01babde-e3ee-470f-b582-4c18702d570c already deleted. [ 605.912432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d01babde-e3ee-470f-b582-4c18702d570c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.465180] env[65511]: INFO networking_nsxv3.common.synchronization [None req-319e2c7c-da58-4ef3-bf01-3965924cc090 None None] Enqueued Resource ID: f16f724e-1a58-432f-970d-899a8fffcc41 with Priority: HIGHEST for action port [ 606.465180] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f16f724e-1a58-432f-970d-899a8fffcc41 with Priority: HIGHEST for action port [ 606.465180] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f16f724e-1a58-432f-970d-899a8fffcc41 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.465180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f16f724e-1a58-432f-970d-899a8fffcc41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.465180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f16f724e-1a58-432f-970d-899a8fffcc41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.465180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f16f724e-1a58-432f-970d-899a8fffcc41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.465180] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f16f724e-1a58-432f-970d-899a8fffcc41',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.969287] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f16f724e-1a58-432f-970d-899a8fffcc41 [ 606.969287] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.969287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.969287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.969287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.969287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.969287] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f16f724e-1a58-432f-970d-899a8fffcc41 already deleted. [ 606.969287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f16f724e-1a58-432f-970d-899a8fffcc41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.031476] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e7247107-1681-4081-88e4-36099a8d8e09 None None] Enqueued Resource ID: 3cc82ecd-01b0-42df-9734-158c01ea55d5 with Priority: HIGHEST for action port [ 607.031476] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc82ecd-01b0-42df-9734-158c01ea55d5 with Priority: HIGHEST for action port [ 607.031861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc82ecd-01b0-42df-9734-158c01ea55d5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.031861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc82ecd-01b0-42df-9734-158c01ea55d5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.033081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc82ecd-01b0-42df-9734-158c01ea55d5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.037095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc82ecd-01b0-42df-9734-158c01ea55d5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.037095] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc82ecd-01b0-42df-9734-158c01ea55d5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.539115] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc82ecd-01b0-42df-9734-158c01ea55d5 [ 607.539498] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.539993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.540117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.540668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.540849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.541154] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc82ecd-01b0-42df-9734-158c01ea55d5 already deleted. [ 607.541251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc82ecd-01b0-42df-9734-158c01ea55d5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.916621] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a7d6f2c2-1f8a-4341-bb57-0731b0e2772d None None] Enqueued Resource ID: 1ecf973a-8b8e-4e82-b213-71a1c33069e1 with Priority: HIGHEST for action port [ 607.917209] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecf973a-8b8e-4e82-b213-71a1c33069e1 with Priority: HIGHEST for action port [ 607.917502] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ecf973a-8b8e-4e82-b213-71a1c33069e1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.917667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ecf973a-8b8e-4e82-b213-71a1c33069e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.917712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ecf973a-8b8e-4e82-b213-71a1c33069e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.919391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ecf973a-8b8e-4e82-b213-71a1c33069e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.921297] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ecf973a-8b8e-4e82-b213-71a1c33069e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.168740] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ce4aafd4-b6a5-4d6b-a249-5233a6ee4497 None None] Enqueued Resource ID: 5521258f-8b2f-49d1-a665-cbd000e3b35a with Priority: HIGHEST for action port [ 608.169455] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5521258f-8b2f-49d1-a665-cbd000e3b35a with Priority: HIGHEST for action port [ 608.169737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5521258f-8b2f-49d1-a665-cbd000e3b35a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.169879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5521258f-8b2f-49d1-a665-cbd000e3b35a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.170309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5521258f-8b2f-49d1-a665-cbd000e3b35a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.170309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5521258f-8b2f-49d1-a665-cbd000e3b35a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.170309] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5521258f-8b2f-49d1-a665-cbd000e3b35a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.435534] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ecf973a-8b8e-4e82-b213-71a1c33069e1 [ 608.435534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.435534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.435534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.435534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.435783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.435783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ecf973a-8b8e-4e82-b213-71a1c33069e1 already deleted. [ 608.435842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ecf973a-8b8e-4e82-b213-71a1c33069e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.673862] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5521258f-8b2f-49d1-a665-cbd000e3b35a [ 608.673862] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.674173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.677505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.677505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.677505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.677505] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5521258f-8b2f-49d1-a665-cbd000e3b35a already deleted. [ 608.677505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5521258f-8b2f-49d1-a665-cbd000e3b35a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.330751] env[65511]: INFO networking_nsxv3.common.synchronization [None req-83fb2947-1deb-4d6e-8c09-fecac97b938d None None] Enqueued Resource ID: 34292a2b-6afd-439a-b0eb-edd668a3a821 with Priority: HIGHEST for action port [ 609.331702] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34292a2b-6afd-439a-b0eb-edd668a3a821 with Priority: HIGHEST for action port [ 609.332015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-34292a2b-6afd-439a-b0eb-edd668a3a821 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.332387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34292a2b-6afd-439a-b0eb-edd668a3a821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.332387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34292a2b-6afd-439a-b0eb-edd668a3a821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.332713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34292a2b-6afd-439a-b0eb-edd668a3a821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.332968] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34292a2b-6afd-439a-b0eb-edd668a3a821',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.836440] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34292a2b-6afd-439a-b0eb-edd668a3a821 [ 609.836440] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.836440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.836440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.836440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.836440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.836440] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34292a2b-6afd-439a-b0eb-edd668a3a821 already deleted. [ 609.836440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34292a2b-6afd-439a-b0eb-edd668a3a821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.305302] env[65511]: INFO networking_nsxv3.common.synchronization [None req-50a1a182-7645-4184-b4cd-7544b053244e None None] Enqueued Resource ID: 0aeea1cc-5b5f-4c40-a7dd-25151709a8ba with Priority: HIGHEST for action port [ 610.305587] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aeea1cc-5b5f-4c40-a7dd-25151709a8ba with Priority: HIGHEST for action port [ 610.307585] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aeea1cc-5b5f-4c40-a7dd-25151709a8ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.307817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aeea1cc-5b5f-4c40-a7dd-25151709a8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.307940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aeea1cc-5b5f-4c40-a7dd-25151709a8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.308265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aeea1cc-5b5f-4c40-a7dd-25151709a8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.308546] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aeea1cc-5b5f-4c40-a7dd-25151709a8ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.320664] env[65511]: INFO networking_nsxv3.common.synchronization [None req-97de626d-da6f-4a41-ad8c-c7854469bd63 None None] Enqueued Resource ID: 4c499c42-ec3e-4436-86cc-38495863b7ff with Priority: HIGHEST for action port [ 610.320843] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c499c42-ec3e-4436-86cc-38495863b7ff with Priority: HIGHEST for action port [ 610.321546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c499c42-ec3e-4436-86cc-38495863b7ff taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.321546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c499c42-ec3e-4436-86cc-38495863b7ff" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.321546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c499c42-ec3e-4436-86cc-38495863b7ff" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.321793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c499c42-ec3e-4436-86cc-38495863b7ff" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.321874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c499c42-ec3e-4436-86cc-38495863b7ff',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.811239] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0aeea1cc-5b5f-4c40-a7dd-25151709a8ba [ 610.811478] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.811614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.811685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.811901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.811990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.812098] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0aeea1cc-5b5f-4c40-a7dd-25151709a8ba already deleted. [ 610.812389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aeea1cc-5b5f-4c40-a7dd-25151709a8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823731] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c499c42-ec3e-4436-86cc-38495863b7ff [ 610.824078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.824078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.824231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.825368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.825465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.825568] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c499c42-ec3e-4436-86cc-38495863b7ff already deleted. [ 610.825655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c499c42-ec3e-4436-86cc-38495863b7ff" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.623777] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a87b0891-d092-4a61-a308-d0b81c7eb75e None None] Enqueued Resource ID: 2dac3ddd-a55b-4908-b477-1ec84e88cb44 with Priority: HIGHEST for action port [ 611.625657] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dac3ddd-a55b-4908-b477-1ec84e88cb44 with Priority: HIGHEST for action port [ 611.625657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dac3ddd-a55b-4908-b477-1ec84e88cb44 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.625657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dac3ddd-a55b-4908-b477-1ec84e88cb44" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.627405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dac3ddd-a55b-4908-b477-1ec84e88cb44" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.627405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dac3ddd-a55b-4908-b477-1ec84e88cb44" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.627405] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dac3ddd-a55b-4908-b477-1ec84e88cb44',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.128862] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dac3ddd-a55b-4908-b477-1ec84e88cb44 [ 612.129153] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.129292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.129292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.129504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.129595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.129691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dac3ddd-a55b-4908-b477-1ec84e88cb44 already deleted. [ 612.129771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dac3ddd-a55b-4908-b477-1ec84e88cb44" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.916324] env[65511]: INFO networking_nsxv3.common.synchronization [None req-fc9dc433-333a-4660-be07-b382dd73fc7a tempest-ServersV294TestFqdnHostnames-358523912 tempest-ServersV294TestFqdnHostnames-358523912-project-member] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 613.917054] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 613.917362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.917486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.917568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.918799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.918799] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.188198] env[65511]: INFO networking_nsxv3.common.synchronization [None req-37e46268-b151-4702-8535-607a78022b7d None None] Enqueued Resource ID: 33d54bb7-b444-4285-a439-b6a083f19284 with Priority: HIGHEST for action port [ 614.192248] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d54bb7-b444-4285-a439-b6a083f19284 with Priority: HIGHEST for action port [ 614.192248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-33d54bb7-b444-4285-a439-b6a083f19284 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.192248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33d54bb7-b444-4285-a439-b6a083f19284" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.192248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33d54bb7-b444-4285-a439-b6a083f19284" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.192248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33d54bb7-b444-4285-a439-b6a083f19284" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.192248] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d54bb7-b444-4285-a439-b6a083f19284',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.328902] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1e4d3b41-bcdd-4673-a53b-5408e1eeacd5 tempest-ServersV294TestFqdnHostnames-358523912 tempest-ServersV294TestFqdnHostnames-358523912-project-member] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 614.328902] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 614.329434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.329434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.404078] env[65511]: INFO networking_nsxv3.common.synchronization [None req-62c4df97-47ca-4fa9-a037-63385bd6f85e None None] Enqueued Resource ID: bd97818d-42f3-428f-87fa-6efb1389bab4 with Priority: HIGHEST for action port [ 614.405116] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd97818d-42f3-428f-87fa-6efb1389bab4 with Priority: HIGHEST for action port [ 614.407762] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd97818d-42f3-428f-87fa-6efb1389bab4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.408105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd97818d-42f3-428f-87fa-6efb1389bab4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.408105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd97818d-42f3-428f-87fa-6efb1389bab4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.408511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd97818d-42f3-428f-87fa-6efb1389bab4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.408511] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd97818d-42f3-428f-87fa-6efb1389bab4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.443794] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.443794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.443794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.443794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.443794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.443794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf already deleted. [ 614.443794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.444104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.444104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.444104] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.694463] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33d54bb7-b444-4285-a439-b6a083f19284 [ 614.694750] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.694863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.694934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.695171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.695277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.695680] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33d54bb7-b444-4285-a439-b6a083f19284 already deleted. [ 614.695680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33d54bb7-b444-4285-a439-b6a083f19284" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.910356] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd97818d-42f3-428f-87fa-6efb1389bab4 [ 614.911386] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.911386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.911386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.911386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.911386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.911386] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd97818d-42f3-428f-87fa-6efb1389bab4 already deleted. [ 614.911386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd97818d-42f3-428f-87fa-6efb1389bab4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.966284] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.966601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.966601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.966672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.966971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.966971] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf already deleted. [ 614.966971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.573126] env[65511]: INFO networking_nsxv3.common.synchronization [None req-933d1f20-f62f-4795-8aea-54c221ddf398 None None] Enqueued Resource ID: 0c4c68c1-7c02-4cb7-a83f-d0285bd05e20 with Priority: HIGHEST for action port [ 615.573524] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4c68c1-7c02-4cb7-a83f-d0285bd05e20 with Priority: HIGHEST for action port [ 615.574225] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c4c68c1-7c02-4cb7-a83f-d0285bd05e20 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.574423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c4c68c1-7c02-4cb7-a83f-d0285bd05e20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.574526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c4c68c1-7c02-4cb7-a83f-d0285bd05e20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.575109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c4c68c1-7c02-4cb7-a83f-d0285bd05e20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.575109] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4c68c1-7c02-4cb7-a83f-d0285bd05e20',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.711922] env[65511]: INFO networking_nsxv3.common.synchronization [req-4c61e352-f89b-4e46-aff8-173eea15e565 req-143a665b-462e-4851-b6cf-62371de23db1 tempest-DeleteServersAdminTestJSON-1445424325 tempest-DeleteServersAdminTestJSON-1445424325-project-member] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 615.711922] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 615.711922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.711922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.711922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.711922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.711922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.715032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.715032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.715032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.715032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.715032] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.077437] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c4c68c1-7c02-4cb7-a83f-d0285bd05e20 [ 616.077716] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.078037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.078037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.078106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.078248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.078358] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c4c68c1-7c02-4cb7-a83f-d0285bd05e20 already deleted. [ 616.078435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c4c68c1-7c02-4cb7-a83f-d0285bd05e20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.219371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.219371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.219885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.219885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.219885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.219885] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 already deleted. [ 616.219885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.546979] env[65511]: INFO networking_nsxv3.common.synchronization [None req-df456469-9267-4545-bfbe-1d615e6c8fc1 None None] Enqueued Resource ID: 1227f1a3-5002-4b43-ab95-79e6ab282fe0 with Priority: HIGHEST for action port [ 616.546979] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1227f1a3-5002-4b43-ab95-79e6ab282fe0 with Priority: HIGHEST for action port [ 616.546979] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1227f1a3-5002-4b43-ab95-79e6ab282fe0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.546979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1227f1a3-5002-4b43-ab95-79e6ab282fe0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.546979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1227f1a3-5002-4b43-ab95-79e6ab282fe0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.547457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1227f1a3-5002-4b43-ab95-79e6ab282fe0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.547512] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1227f1a3-5002-4b43-ab95-79e6ab282fe0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.567264] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.567264] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.567264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.568581] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.568581] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.568581] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.568581] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.568581] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.568581] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.568581] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.590320] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.590497] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.590625] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.590819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.591216] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-dbd3a38d-7feb-4981-9bbd-30401adf6e80 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.591396] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.591529] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.591854] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.592054] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd3a38d-7feb-4981-9bbd-30401adf6e80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.784828] env[65511]: INFO networking_nsxv3.common.synchronization [None req-40ef8128-56f1-423c-962f-b9d5cdf39c7d None None] Enqueued Resource ID: adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f with Priority: HIGHEST for action port [ 616.785617] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f with Priority: HIGHEST for action port [ 616.785705] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.785811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.785895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.786484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.786593] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.854573] env[65511]: INFO networking_nsxv3.common.synchronization [req-745b8e8c-20da-47eb-ab64-ea7842b08f33 req-742b15ca-3acc-4fcf-968c-06acb409714d tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 616.855942] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 616.855942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.855942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.855942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.855942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.856213] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.856213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.856213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.856331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.856401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.856482] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.049092] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1227f1a3-5002-4b43-ab95-79e6ab282fe0 [ 617.049324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.049454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.049831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.049831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.049901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.050174] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1227f1a3-5002-4b43-ab95-79e6ab282fe0 already deleted. [ 617.050174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1227f1a3-5002-4b43-ab95-79e6ab282fe0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.094580] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.095121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.095121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.095392] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.095532] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.095678] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port dbd3a38d-7feb-4981-9bbd-30401adf6e80 not found, creating... [ 617.095948] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.096108] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.096243] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.096424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.096551] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.096908] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.097069] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.097180] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.097378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.097502] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.097632] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: dbd3a38d-7feb-4981-9bbd-30401adf6e80 is going to be created. [ 617.125209] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.125527] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.125828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.125966] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.126201] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.126460] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.238709] env[65511]: INFO networking_nsxv3.common.synchronization [None req-623c7953-6301-48e8-af4b-b4facc13910c None None] Enqueued Resource ID: 1f67d4d5-38ff-4a22-8324-0eba3b82e8e7 with Priority: HIGHEST for action port [ 617.239257] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f67d4d5-38ff-4a22-8324-0eba3b82e8e7 with Priority: HIGHEST for action port [ 617.239552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f67d4d5-38ff-4a22-8324-0eba3b82e8e7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.239680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f67d4d5-38ff-4a22-8324-0eba3b82e8e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.239763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f67d4d5-38ff-4a22-8324-0eba3b82e8e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.240680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f67d4d5-38ff-4a22-8324-0eba3b82e8e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.240798] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f67d4d5-38ff-4a22-8324-0eba3b82e8e7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.289086] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f [ 617.289328] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.289467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.289536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.289827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.289941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.290025] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f already deleted. [ 617.290106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adcb779f-ff5c-4c5f-9d01-9ab0cdd37e1f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.360068] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.360274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.360384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.360583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.360676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.360873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.360969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.361042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.361196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.361271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.361358] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 already deleted. [ 617.361440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.371211] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.371377] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.371506] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.371829] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.372334] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.372543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.372659] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.372873] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.373015] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.373215] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.373319] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.373420] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.373668] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.373834] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.373942] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.374075] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.395934] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.396100] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.397020] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.397020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.397020] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-995f5d9c-fd96-4776-b6f4-fe18f6495632 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.397020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.397020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.397283] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.397416] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995f5d9c-fd96-4776-b6f4-fe18f6495632',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.743176] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f67d4d5-38ff-4a22-8324-0eba3b82e8e7 [ 617.743176] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.743335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.743335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.743523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.743641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.743781] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f67d4d5-38ff-4a22-8324-0eba3b82e8e7 already deleted. [ 617.743875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f67d4d5-38ff-4a22-8324-0eba3b82e8e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.882375] env[65511]: INFO networking_nsxv3.common.synchronization [req-4c61e352-f89b-4e46-aff8-173eea15e565 req-23c4648c-364e-4128-a2f6-4deb134b1063 service nova] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_rules [ 617.882541] env[65511]: INFO networking_nsxv3.common.synchronization [req-4c61e352-f89b-4e46-aff8-173eea15e565 req-23c4648c-364e-4128-a2f6-4deb134b1063 service nova] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 617.882675] env[65511]: INFO networking_nsxv3.common.synchronization [req-4c61e352-f89b-4e46-aff8-173eea15e565 req-23c4648c-364e-4128-a2f6-4deb134b1063 service nova] Enqueued Resource ID: dbd3a38d-7feb-4981-9bbd-30401adf6e80 with Priority: HIGHEST for action port [ 617.883358] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_rules [ 617.883498] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 617.883647] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbd3a38d-7feb-4981-9bbd-30401adf6e80 with Priority: HIGHEST for action port [ 617.884056] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.884150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.884217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.884512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.884554] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.885379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.885497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.885564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.885805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.885958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.886058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.886119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.886268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.886350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.886435] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.887505] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbd3a38d-7feb-4981-9bbd-30401adf6e80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.887697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.887697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.888524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.888524] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd3a38d-7feb-4981-9bbd-30401adf6e80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.900097] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.900311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.900416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.900669] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.900808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.901026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 995f5d9c-fd96-4776-b6f4-fe18f6495632 not found, creating... [ 617.901206] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.901350] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.901454] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.901764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.901865] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.902074] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.902484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.902484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.902580] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.902711] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.902788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 995f5d9c-fd96-4776-b6f4-fe18f6495632 is going to be created. [ 617.924191] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.924433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.924493] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.924983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.925227] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.925438] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.184582] env[65511]: INFO networking_nsxv3.common.synchronization [None req-149209ff-46b9-4f35-8f6d-218ef08f6284 None None] Enqueued Resource ID: a1b6873e-b162-402b-a05f-8e419f2a318b with Priority: HIGHEST for action port [ 618.185166] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b6873e-b162-402b-a05f-8e419f2a318b with Priority: HIGHEST for action port [ 618.185471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1b6873e-b162-402b-a05f-8e419f2a318b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.185596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1b6873e-b162-402b-a05f-8e419f2a318b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.185662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1b6873e-b162-402b-a05f-8e419f2a318b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.186368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1b6873e-b162-402b-a05f-8e419f2a318b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.186463] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b6873e-b162-402b-a05f-8e419f2a318b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.391081] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.391396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.400333] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.400333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbd3a38d-7feb-4981-9bbd-30401adf6e80 with status ACTIVE [ 618.400485] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.400485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.400588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.401817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.401914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.402134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.402247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.402303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.402476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.402554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.402744] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.402837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.402898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.403611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.403611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.403611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbd3a38d-7feb-4981-9bbd-30401adf6e80 is going to be updated. [ 618.425520] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.425661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.425727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.425937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.426087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.426421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbd3a38d-7feb-4981-9bbd-30401adf6e80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.688617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1b6873e-b162-402b-a05f-8e419f2a318b [ 618.688842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.689664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.689664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.689664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.689664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.689664] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1b6873e-b162-402b-a05f-8e419f2a318b already deleted. [ 618.689664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1b6873e-b162-402b-a05f-8e419f2a318b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.753233] env[65511]: INFO networking_nsxv3.common.synchronization [req-745b8e8c-20da-47eb-ab64-ea7842b08f33 req-0f252fd0-3288-4274-b2a1-1b8930e78644 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 618.753407] env[65511]: INFO networking_nsxv3.common.synchronization [req-745b8e8c-20da-47eb-ab64-ea7842b08f33 req-0f252fd0-3288-4274-b2a1-1b8930e78644 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 618.753538] env[65511]: INFO networking_nsxv3.common.synchronization [req-745b8e8c-20da-47eb-ab64-ea7842b08f33 req-0f252fd0-3288-4274-b2a1-1b8930e78644 service nova] Enqueued Resource ID: 995f5d9c-fd96-4776-b6f4-fe18f6495632 with Priority: HIGHEST for action port [ 618.754082] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 618.754214] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 618.754568] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 995f5d9c-fd96-4776-b6f4-fe18f6495632 with Priority: HIGHEST for action port [ 618.754618] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.754747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.754798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.755095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.755186] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.756328] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.756499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.756562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.756730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.756874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.756966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.757058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.757266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.757533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.757533] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.758465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-995f5d9c-fd96-4776-b6f4-fe18f6495632 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.758465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.758589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.758620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.758699] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('995f5d9c-fd96-4776-b6f4-fe18f6495632',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.906467] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.253793] env[65511]: INFO networking_nsxv3.common.synchronization [req-002a31fc-4931-4a48-9294-7c7a4f2fd71e req-a62b4cf4-9bc2-42ea-baca-deb818d8ebad tempest-ServerExternalEventsTest-104113178 tempest-ServerExternalEventsTest-104113178-project-member] Enqueued Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 619.253793] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 619.254086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.254086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.254086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.256363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.256363] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.256363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.256363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.256363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.256363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.256363] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.261299] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.262323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.262437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.262613] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 995f5d9c-fd96-4776-b6f4-fe18f6495632 with status ACTIVE [ 619.262813] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.262947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.263061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.263189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.263291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.263478] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.263625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.263687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.263869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.263957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.264140] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.264229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.264292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.264460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.264550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.264646] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 995f5d9c-fd96-4776-b6f4-fe18f6495632 is going to be updated. [ 619.288096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.288096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.288096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.288096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.288096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.288096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-995f5d9c-fd96-4776-b6f4-fe18f6495632" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.408615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.410155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.410274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.410474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.410568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.410673] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be created. [ 619.478961] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.478961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.478961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.478961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.479925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.500259] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: UNINITIALIZED for 2s [ 619.694448] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.694808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.695983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.696350] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.696709] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.697443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.697443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.697443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.697443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.697678] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.697678] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.697734] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.698351] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.698351] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.698351] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.698351] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.719638] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.719638] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.719837] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.719980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.720324] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3823c570-9a76-4183-a6d5-2a002c58d793 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.720495] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.720904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.721555] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.721698] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3823c570-9a76-4183-a6d5-2a002c58d793',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.758243] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.758530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.758530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.759291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.759739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.759739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.759739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.760284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.760284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.760284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.760785] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b already deleted. [ 619.760886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.766703] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.937227] env[65511]: INFO networking_nsxv3.common.synchronization [None req-29149501-2c73-4f54-b72a-603192bc3c13 None None] Enqueued Resource ID: aa95b720-c73f-4879-841a-44b15e2e4f41 with Priority: HIGHEST for action port [ 619.937906] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa95b720-c73f-4879-841a-44b15e2e4f41 with Priority: HIGHEST for action port [ 619.938149] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa95b720-c73f-4879-841a-44b15e2e4f41 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.938321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa95b720-c73f-4879-841a-44b15e2e4f41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.938675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa95b720-c73f-4879-841a-44b15e2e4f41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.938946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa95b720-c73f-4879-841a-44b15e2e4f41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.939046] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa95b720-c73f-4879-841a-44b15e2e4f41',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.224530] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.224815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.224943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.225227] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.225362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.225504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3823c570-9a76-4183-a6d5-2a002c58d793 not found, creating... [ 620.225751] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.225894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.226010] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.226229] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.226372] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.226756] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.226999] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.227135] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.227343] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.230482] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.230482] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3823c570-9a76-4183-a6d5-2a002c58d793 is going to be created. [ 620.251748] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.251953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.252065] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.252342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.253230] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.253230] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.269149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.269149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.269452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.269690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.269829] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be created. [ 620.328509] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.328713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.328713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.328928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.329109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.340243] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: UNINITIALIZED for 2s [ 620.441970] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa95b720-c73f-4879-841a-44b15e2e4f41 [ 620.442240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.442375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.442441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.442847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.442847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.443056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa95b720-c73f-4879-841a-44b15e2e4f41 already deleted. [ 620.443056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa95b720-c73f-4879-841a-44b15e2e4f41" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.938084] env[65511]: INFO networking_nsxv3.common.synchronization [req-002a31fc-4931-4a48-9294-7c7a4f2fd71e req-a2bb8ec7-9c50-41d8-9267-fd0b3079e5ef service nova] Enqueued Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_rules [ 620.938247] env[65511]: INFO networking_nsxv3.common.synchronization [req-002a31fc-4931-4a48-9294-7c7a4f2fd71e req-a2bb8ec7-9c50-41d8-9267-fd0b3079e5ef service nova] Enqueued Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 620.938383] env[65511]: INFO networking_nsxv3.common.synchronization [req-002a31fc-4931-4a48-9294-7c7a4f2fd71e req-a2bb8ec7-9c50-41d8-9267-fd0b3079e5ef service nova] Enqueued Resource ID: 3823c570-9a76-4183-a6d5-2a002c58d793 with Priority: HIGHEST for action port [ 620.939996] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_rules [ 620.940085] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 620.940131] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3823c570-9a76-4183-a6d5-2a002c58d793 with Priority: HIGHEST for action port [ 620.940418] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.940542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.940620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.941065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.941148] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.942412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.942533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.942601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.942777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.942928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.943167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.943167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.943279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.943350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.943434] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.944172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3823c570-9a76-4183-a6d5-2a002c58d793 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.944276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.944341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.944521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.944586] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3823c570-9a76-4183-a6d5-2a002c58d793',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.093887] env[65511]: INFO networking_nsxv3.common.synchronization [None req-dd7338c5-8cdd-441d-8146-0b3019d3b35c tempest-VolumesAssistedSnapshotsTest-1228276739 tempest-VolumesAssistedSnapshotsTest-1228276739-project-member] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 621.095725] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 621.095725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.095725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.095725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.095725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.095725] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.276523] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0d17e5f2-b044-4023-8ab0-da639671a41d None None] Enqueued Resource ID: f799da2c-8563-417b-b58a-4603adf5031f with Priority: HIGHEST for action port [ 621.278425] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f799da2c-8563-417b-b58a-4603adf5031f with Priority: HIGHEST for action port [ 621.278425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f799da2c-8563-417b-b58a-4603adf5031f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.278425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f799da2c-8563-417b-b58a-4603adf5031f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.278425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f799da2c-8563-417b-b58a-4603adf5031f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.278425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f799da2c-8563-417b-b58a-4603adf5031f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.278425] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f799da2c-8563-417b-b58a-4603adf5031f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.380110] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9f8d233d-f48f-4c2c-87c6-b5ae4377539d tempest-VolumesAssistedSnapshotsTest-1228276739 tempest-VolumesAssistedSnapshotsTest-1228276739-project-member] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 621.380634] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 621.381209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.381209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448018] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.448018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.448018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448018] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3823c570-9a76-4183-a6d5-2a002c58d793 with status ACTIVE [ 621.448018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.448018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.448018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.448018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.448018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.448558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.448558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.448558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.448558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.448707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.449243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.449243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.449243] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3823c570-9a76-4183-a6d5-2a002c58d793 is going to be updated. [ 621.473685] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.473835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.473903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.474184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.475772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.475936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3823c570-9a76-4183-a6d5-2a002c58d793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.503967] env[65511]: INFO networking_nsxv3.common.synchronization [None req-86ae9800-ad4f-4abb-9cec-0b7a5bd6c596 None None] Enqueued Resource ID: 5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c with Priority: HIGHEST for action port [ 621.505959] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c with Priority: HIGHEST for action port [ 621.506717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.506842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.506909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.507209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.507296] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.514028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 621.514269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.514786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.515009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.515235] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.515349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.515413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.515576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.515651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.515731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.515855] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.622846] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.622846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 already deleted. [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.622846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.622846] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.761877] env[65511]: INFO networking_nsxv3.common.synchronization [req-a310d791-1ca2-47b5-add0-c03a59804033 req-e3af77a4-c886-4731-9804-df19eeef35f1 tempest-ImagesNegativeTestJSON-121071014 tempest-ImagesNegativeTestJSON-121071014-project-member] Enqueued Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 621.761877] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 621.761877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.761877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.761877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.762275] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.782655] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f799da2c-8563-417b-b58a-4603adf5031f [ 621.783115] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.783115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.783267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.783359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.783455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.783550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f799da2c-8563-417b-b58a-4603adf5031f already deleted. [ 621.783937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f799da2c-8563-417b-b58a-4603adf5031f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.953178] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.009850] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c [ 622.012798] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.012798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.012798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.012798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.012798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.012798] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c already deleted. [ 622.012798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a15bdcf-933a-4ab6-8eb1-bd5d4d21df1c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.022504] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.022860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.023555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.023935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.024250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.024602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.026320] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.026320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.027014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.027163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.029303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.029303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.029303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.029303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029303] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.145503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.145780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.145780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.145854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.146279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.146279] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 already deleted. [ 622.146279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.257115] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-459 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.257304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-459" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.257418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-459" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.257738] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-459" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259684] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.259882] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.259997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.261404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.261537] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.261774] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.261882] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.261982] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.262098] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.262606] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.262606] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.262606] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.267807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.267807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.267807] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb already deleted. [ 622.267807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.282314] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.282635] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.282635] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.283145] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-459" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.283145] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.283309] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.283360] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.283635] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.283842] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a7a175-53fb-4fd6-9d72-f9c12f2f598b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.351252] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 622.351820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.352230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.352641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.352987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.353294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.353476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.353872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.354107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.354354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.354554] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.380018] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a5fb3ae5-f56c-4fc4-8e4b-4aa9d2ada791 None None] Enqueued Resource ID: 82e06eac-64b8-457a-acf1-a4f3e48b81fd with Priority: HIGHEST for action port [ 622.380018] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e06eac-64b8-457a-acf1-a4f3e48b81fd with Priority: HIGHEST for action port [ 622.382427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e06eac-64b8-457a-acf1-a4f3e48b81fd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.382427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e06eac-64b8-457a-acf1-a4f3e48b81fd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.382427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e06eac-64b8-457a-acf1-a4f3e48b81fd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.382427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e06eac-64b8-457a-acf1-a4f3e48b81fd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.382427] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e06eac-64b8-457a-acf1-a4f3e48b81fd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.458555] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.458555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.458555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.458555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.458555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.458555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b is going to be created. [ 622.490345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.490523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.490663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.490853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.491213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.504557] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: UNINITIALIZED for 2s [ 622.530175] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6768aa0-c3a8-4794-8747-efcb8cb86558: rpc.has_security_group_logging(os_id): False [ 622.554062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554674] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.554674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.554674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.554674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.554674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.554674] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be created. [ 622.627666] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.627666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.627666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.627949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.627949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.641439] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 622.787478] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.787667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.787789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.788089] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.788232] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.788382] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 43a7a175-53fb-4fd6-9d72-f9c12f2f598b not found, creating... [ 622.788630] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.788776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.788884] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.789113] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.789238] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.789523] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.789668] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.789779] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.789980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.791242] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.791242] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 43a7a175-53fb-4fd6-9d72-f9c12f2f598b is going to be created. [ 622.821043] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.821043] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.821043] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.821355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.821391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.821619] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.858251] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.858251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.858251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.858251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.858441] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.858441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.858441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.858642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.858701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.858836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.858944] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.859051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.859084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.859277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.859354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.859443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.859501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.859862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.859862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.859862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.859862] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.884438] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82e06eac-64b8-457a-acf1-a4f3e48b81fd [ 622.884438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.884438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.884438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.884672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.884770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.884875] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82e06eac-64b8-457a-acf1-a4f3e48b81fd already deleted. [ 622.884963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e06eac-64b8-457a-acf1-a4f3e48b81fd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.368158] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49eab9c1-0cf4-4ab1-83f1-830592c0f740: rpc.has_security_group_logging(os_id): False [ 623.388547] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.388694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.388768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.388969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.389119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.389271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.389364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.389472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.389581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.389655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.390315] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.390315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.390315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.390315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.390315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.390547] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.390547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.390547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.390708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.390708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.390788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be created. [ 623.457324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.457461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.457525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.457736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.457910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.472411] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 623.593880] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f568f821-1fa9-495d-a2b2-587fbb9e599b None None] Enqueued Resource ID: 8aff5486-c148-4be0-8824-e376c19ada74 with Priority: HIGHEST for action port [ 623.593880] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aff5486-c148-4be0-8824-e376c19ada74 with Priority: HIGHEST for action port [ 623.593880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aff5486-c148-4be0-8824-e376c19ada74 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.593880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aff5486-c148-4be0-8824-e376c19ada74" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.593880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aff5486-c148-4be0-8824-e376c19ada74" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.593880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aff5486-c148-4be0-8824-e376c19ada74" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.593880] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aff5486-c148-4be0-8824-e376c19ada74',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.634156] env[65511]: INFO networking_nsxv3.common.synchronization [req-a310d791-1ca2-47b5-add0-c03a59804033 req-8204e56a-1bac-4f3c-8a79-0c0541934140 service nova] Enqueued Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_rules [ 623.637696] env[65511]: INFO networking_nsxv3.common.synchronization [req-a310d791-1ca2-47b5-add0-c03a59804033 req-8204e56a-1bac-4f3c-8a79-0c0541934140 service nova] Enqueued Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 623.637969] env[65511]: INFO networking_nsxv3.common.synchronization [req-a310d791-1ca2-47b5-add0-c03a59804033 req-8204e56a-1bac-4f3c-8a79-0c0541934140 service nova] Enqueued Resource ID: 43a7a175-53fb-4fd6-9d72-f9c12f2f598b with Priority: HIGHEST for action port [ 623.638558] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_rules [ 623.638771] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 623.638839] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a7a175-53fb-4fd6-9d72-f9c12f2f598b with Priority: HIGHEST for action port [ 623.639471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.639744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.639920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.641432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.641432] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.641432] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.641432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.641605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.642989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.642989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.642989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.642989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.642989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.642989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.642989] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.643763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.643763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.643763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.643986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.644035] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a7a175-53fb-4fd6-9d72-f9c12f2f598b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.715039] env[65511]: INFO networking_nsxv3.common.synchronization [req-5c662315-0785-4a92-a7c1-c767afb658ef req-14a79310-cad8-4f88-9a6b-fe3d1cbe92b8 tempest-FloatingIPsAssociationNegativeTestJSON-1139033214 tempest-FloatingIPsAssociationNegativeTestJSON-1139033214-project-member] Enqueued Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 623.715947] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 623.716381] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.716530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.716598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.716917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.717868] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.718238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.718238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.718238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.718545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.718545] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.857919] env[65511]: INFO networking_nsxv3.common.synchronization [req-240a2358-f5f1-42d8-a4e2-4e9c6694d69e req-d59615cf-2813-4b89-affa-05c483d5e968 tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: e5545717-7220-4e99-872a-5f0bb627e81a with Priority: HIGHEST for action security_group_rules [ 623.858688] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5545717-7220-4e99-872a-5f0bb627e81a with Priority: HIGHEST for action security_group_rules [ 623.859097] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5545717-7220-4e99-872a-5f0bb627e81a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.860946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5545717-7220-4e99-872a-5f0bb627e81a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.860946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5545717-7220-4e99-872a-5f0bb627e81a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.860946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5545717-7220-4e99-872a-5f0bb627e81a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.860946] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5545717-7220-4e99-872a-5f0bb627e81a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.099993] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8aff5486-c148-4be0-8824-e376c19ada74 [ 624.099993] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.099993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.099993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.099993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.099993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.099993] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8aff5486-c148-4be0-8824-e376c19ada74 already deleted. [ 624.099993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aff5486-c148-4be0-8824-e376c19ada74" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.150727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.150727] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.150727] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43a7a175-53fb-4fd6-9d72-f9c12f2f598b with status ACTIVE [ 624.150727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.150727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.150727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.151758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.151758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.151758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.151758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.151758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.151758] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43a7a175-53fb-4fd6-9d72-f9c12f2f598b is going to be updated. [ 624.174265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.174456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.174551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.174770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.174910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.175101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a7a175-53fb-4fd6-9d72-f9c12f2f598b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.187598] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.187799] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-308" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.188060] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-308" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.188436] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-308" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.188732] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.188971] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.189128] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.189834] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.190078] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.190327] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.190463] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.190592] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.190918] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.191141] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.191977] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.191977] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.213364] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.213364] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.213364] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.213364] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-308" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.213364] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-08b77971-aaf4-49b0-9f24-abf0908d06aa taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.213693] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.213693] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.214738] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.214738] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b77971-aaf4-49b0-9f24-abf0908d06aa',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.220769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.220769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.220769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.221071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.221331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.221411] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.221476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.221536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.221695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.221780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.221860] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf already deleted. [ 624.221939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.382905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.383738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.383738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.383866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.383919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.383984] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5545717-7220-4e99-872a-5f0bb627e81a already deleted. [ 624.384078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5545717-7220-4e99-872a-5f0bb627e81a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.515550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: SUCCESS [ 624.515764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.515931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.516189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.516387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.516504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.516572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.517320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.517320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.517320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.517320] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.655180] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.659077] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 624.659371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.718777] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.718992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.719614] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.719614] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.719731] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.720421] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 08b77971-aaf4-49b0-9f24-abf0908d06aa not found, creating... [ 624.720421] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.720421] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.720835] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.721116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.721254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.721568] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.721751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.721868] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.722106] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.722249] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.722384] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 08b77971-aaf4-49b0-9f24-abf0908d06aa is going to be created. [ 624.744550] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.744675] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.744728] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.744988] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.745220] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.745475] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.019074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.019265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.019365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.019659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.019806] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.019895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.019960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.020157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.020270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.020364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.020518] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.020609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.020667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.020810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.020970] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.021039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.021102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.021279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.021382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021594] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.158379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.158550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.158625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.158879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.159018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.159156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb is going to be created. [ 625.183332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.183482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.183549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.183877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.186147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.199096] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: UNINITIALIZED for 2s [ 625.487846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 625.488185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [req-5c662315-0785-4a92-a7c1-c767afb658ef req-b51464ce-ee22-4c49-a6dd-3ab1e9866171 service nova] Enqueued Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_rules [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [req-5c662315-0785-4a92-a7c1-c767afb658ef req-b51464ce-ee22-4c49-a6dd-3ab1e9866171 service nova] Enqueued Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [req-5c662315-0785-4a92-a7c1-c767afb658ef req-b51464ce-ee22-4c49-a6dd-3ab1e9866171 service nova] Enqueued Resource ID: 08b77971-aaf4-49b0-9f24-abf0908d06aa with Priority: HIGHEST for action port [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_rules [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 625.508498] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b77971-aaf4-49b0-9f24-abf0908d06aa with Priority: HIGHEST for action port [ 625.508498] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.508498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.508498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.508498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.509223] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.509429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.509534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.509598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.509870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.510223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.510537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.510631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.510800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.510894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.510994] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.511818] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b77971-aaf4-49b0-9f24-abf0908d06aa taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.511970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.512014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.512171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.512242] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b77971-aaf4-49b0-9f24-abf0908d06aa',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.525955] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d28d366-53ef-44cf-aae9-28a5d620d19b: rpc.has_security_group_logging(os_id): False [ 625.545622] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.545907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.545907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.547434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.547434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.547434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.548119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.548119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.548119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.548119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.548119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.548291] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b is going to be created. [ 625.618688] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.618918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.618918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.619138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.619321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.640079] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: IN_PROGRESS for 2s [ 626.020467] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.020467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.020467] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.020467] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08b77971-aaf4-49b0-9f24-abf0908d06aa with status ACTIVE [ 626.020467] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.020467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.020467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.020467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.020467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.020940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.020940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.020940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.020940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.021080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.023159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.023159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.023159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.023159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.025348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.025348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08b77971-aaf4-49b0-9f24-abf0908d06aa is going to be updated. [ 626.049031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.049188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.049260] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.049577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.049641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.049770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b77971-aaf4-49b0-9f24-abf0908d06aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.206164] env[65511]: INFO networking_nsxv3.common.synchronization [req-ca0201ac-f7f4-4820-b2e5-7521fbb3ac49 req-01b06cb7-6229-4b5e-aecf-db411c5f2fb9 tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 626.206702] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 626.207013] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.208443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.208443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.209427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.209427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.209427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.209427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.209427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.209684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.209820] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.526873] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.586874] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.587073] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.587564] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.587564] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.587711] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.587812] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.587916] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.588802] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.589068] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.590283] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.590474] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.590585] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.590687] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.591059] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.591059] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.591059] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.612583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.612665] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.612977] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.612977] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.613311] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-4a18be69-1610-4765-be2f-4b7b529899d2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.613573] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.613760] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.614090] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.614201] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a18be69-1610-4765-be2f-4b7b529899d2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.714052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.714052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.714374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.714374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.714436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.714590] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.714705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.714785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.714912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.715617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.715617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 already deleted. [ 626.715617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.721021] env[65511]: INFO networking_nsxv3.common.synchronization [None req-129fd34f-1b3b-4e84-8c5b-6df2b695ff87 None None] Enqueued Resource ID: e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d with Priority: HIGHEST for action port [ 626.721021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d with Priority: HIGHEST for action port [ 626.721021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.721021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.721021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.721021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.721546] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.028267] env[65511]: INFO networking_nsxv3.common.synchronization [None req-10af07d4-c1a5-46d1-a191-894cda7cc4b2 None None] Enqueued Resource ID: a1618727-55d6-4a8e-8a00-6958318d1fd5 with Priority: HIGHEST for action port [ 627.029048] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1618727-55d6-4a8e-8a00-6958318d1fd5 with Priority: HIGHEST for action port [ 627.029450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1618727-55d6-4a8e-8a00-6958318d1fd5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.029578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1618727-55d6-4a8e-8a00-6958318d1fd5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.029776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1618727-55d6-4a8e-8a00-6958318d1fd5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.030145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1618727-55d6-4a8e-8a00-6958318d1fd5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.030244] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1618727-55d6-4a8e-8a00-6958318d1fd5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.031641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.032217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.032217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.032317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.032447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.032516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf is going to be created. [ 627.057745] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.057911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.057986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.058186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.058356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.069783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: UNINITIALIZED for 2s [ 627.117921] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.118413] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.118662] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.118957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.119393] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.119571] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 4a18be69-1610-4765-be2f-4b7b529899d2 not found, creating... [ 627.120573] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.120751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.120866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.121122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.121257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.121553] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.121936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.121936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.122064] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.122670] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.122817] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 4a18be69-1610-4765-be2f-4b7b529899d2 is going to be created. [ 627.146314] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.146571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.146571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.147058] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.147181] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.147409] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.209012] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: UNINITIALIZED for 4s [ 627.224159] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d [ 627.224395] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.224873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.224968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.225083] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d already deleted. [ 627.225168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8ee3c86-91e8-45d3-9a21-ebb8c2fc813d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.532299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1618727-55d6-4a8e-8a00-6958318d1fd5 [ 627.532601] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.532665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.532719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.532947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.533055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.533155] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1618727-55d6-4a8e-8a00-6958318d1fd5 already deleted. [ 627.533235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1618727-55d6-4a8e-8a00-6958318d1fd5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.663134] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: SUCCESS [ 627.663134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.913663] env[65511]: INFO networking_nsxv3.common.synchronization [req-ca0201ac-f7f4-4820-b2e5-7521fbb3ac49 req-c95fecad-42c7-4d06-b9a6-828df790c462 service nova] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_rules [ 627.913902] env[65511]: INFO networking_nsxv3.common.synchronization [req-ca0201ac-f7f4-4820-b2e5-7521fbb3ac49 req-c95fecad-42c7-4d06-b9a6-828df790c462 service nova] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 627.914142] env[65511]: INFO networking_nsxv3.common.synchronization [req-ca0201ac-f7f4-4820-b2e5-7521fbb3ac49 req-c95fecad-42c7-4d06-b9a6-828df790c462 service nova] Enqueued Resource ID: 4a18be69-1610-4765-be2f-4b7b529899d2 with Priority: HIGHEST for action port [ 627.914766] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_rules [ 627.914924] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 627.918922] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a18be69-1610-4765-be2f-4b7b529899d2 with Priority: HIGHEST for action port [ 627.918922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.918922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.918922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.918922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.918922] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.918922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.918922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.918922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.919438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.919438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.919866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.919922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.920731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.920731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.921134] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.922760] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a18be69-1610-4765-be2f-4b7b529899d2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.922863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.923951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.923951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.923951] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a18be69-1610-4765-be2f-4b7b529899d2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.270103] env[65511]: INFO networking_nsxv3.common.synchronization [req-19aef7b9-e6e7-4bb4-b732-ddfbcb528233 req-449921a7-4976-4a5a-819b-57c31abe73c0 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 628.270103] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 628.270103] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.270103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.270103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.273206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.273206] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.273206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.273206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.273206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.273206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.273206] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.425686] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.426036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.426320] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.427311] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a18be69-1610-4765-be2f-4b7b529899d2 with status ACTIVE [ 628.429041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.429041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.429041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.429041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.431930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.431930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.431930] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a18be69-1610-4765-be2f-4b7b529899d2 is going to be updated. [ 628.455209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.455209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.455209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.455209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.455498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.455642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a18be69-1610-4765-be2f-4b7b529899d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.718520] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.718520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.718520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.718520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.718520] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.719084] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.719084] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.719084] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.719211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.719321] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.719420] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.719589] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.719703] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.719796] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.719889] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.720026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.742129] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.742324] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.742462] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.742772] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.743870] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.744077] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.745648] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.746045] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.746389] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7ebbf5-891b-4e9d-a214-eeb3c527335d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.775818] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.776049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.776115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.776397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.776530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.776750] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.776867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.776931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.777217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.777325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.777459] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f already deleted. [ 628.777570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.932567] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.084171] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: SUCCESS [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.084171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.084171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.084171] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.218293] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: SUCCESS [ 629.218584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.218763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.218978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.219191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.219308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.219371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.219899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.219899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.219899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.220105] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.248629] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.248957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.248957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.249611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.249611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.249611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4a7ebbf5-891b-4e9d-a214-eeb3c527335d not found, creating... [ 629.250143] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.250143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.250143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.250430] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.250480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.250741] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.250869] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.250983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.251201] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.251329] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.251470] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4a7ebbf5-891b-4e9d-a214-eeb3c527335d is going to be created. [ 629.277192] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.277192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.277192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.277192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.277192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.277192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.434879] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.435330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.435422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.435601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.435688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.435792] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be created. [ 629.468639] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.468639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.468922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.468922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.469101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.478699] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: UNINITIALIZED for 2s [ 629.587457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.587680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.587760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.588166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.588166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.588272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.588312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.588463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.588600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.588669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.588847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.588847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.588974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.589385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.589385] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.589385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.589385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.589800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.589800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.589800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.589800] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.722554] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.723015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.723440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.723526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.723711] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.723849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.724067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.724233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.724295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.724341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.724487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.724580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.724728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.725057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.725258] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.725494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.725494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.725631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.725675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.725791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.725835] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.984999] env[65511]: INFO networking_nsxv3.common.synchronization [req-19aef7b9-e6e7-4bb4-b732-ddfbcb528233 req-5529d9ad-ba97-4d4a-8a13-1a507f8856e6 service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 629.985194] env[65511]: INFO networking_nsxv3.common.synchronization [req-19aef7b9-e6e7-4bb4-b732-ddfbcb528233 req-5529d9ad-ba97-4d4a-8a13-1a507f8856e6 service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 629.985586] env[65511]: INFO networking_nsxv3.common.synchronization [req-19aef7b9-e6e7-4bb4-b732-ddfbcb528233 req-5529d9ad-ba97-4d4a-8a13-1a507f8856e6 service nova] Enqueued Resource ID: 4a7ebbf5-891b-4e9d-a214-eeb3c527335d with Priority: HIGHEST for action port [ 629.985999] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 629.986178] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 629.986295] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7ebbf5-891b-4e9d-a214-eeb3c527335d with Priority: HIGHEST for action port [ 629.986958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.986958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.986958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.987222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.987261] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.989534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.989858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.989858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.989989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.990074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.990171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.990232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.990377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.990461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.990556] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.995636] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.995636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.995636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.995636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.995636] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7ebbf5-891b-4e9d-a214-eeb3c527335d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.093132] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1502e09d-ef5c-4d75-b759-794a7bb5c0cf: rpc.has_security_group_logging(os_id): False [ 630.114104] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.114419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.114419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.114526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.114605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.114835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.114968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.115034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.115162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.115240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.115525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.115645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.115645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.115937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.115937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.116078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.116161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.116212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.116314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.116391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.116475] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf is going to be created. [ 630.211096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.211252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.211319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.211538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.211776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.229739] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 591b3b3b-b754-4346-a3c6-b62daea076eb: rpc.has_security_group_logging(os_id): False [ 630.232947] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: IN_PROGRESS for 2s [ 630.264318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.264318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.264318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.264318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.265361] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.265361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.265361] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb is going to be created. [ 630.328040] env[65511]: INFO networking_nsxv3.common.synchronization [req-38f5b002-f5e0-4b38-88b2-9fa342e3f3dd req-8e3f5b9f-b829-4f91-9411-bd7498a76193 tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: 21617e99-a047-4e2c-86c4-2367a5d9ba53 with Priority: HIGHEST for action security_group_rules [ 630.328615] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21617e99-a047-4e2c-86c4-2367a5d9ba53 with Priority: HIGHEST for action security_group_rules [ 630.334213] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21617e99-a047-4e2c-86c4-2367a5d9ba53 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.334213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21617e99-a047-4e2c-86c4-2367a5d9ba53" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.334213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21617e99-a047-4e2c-86c4-2367a5d9ba53" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.334405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21617e99-a047-4e2c-86c4-2367a5d9ba53" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.335046] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21617e99-a047-4e2c-86c4-2367a5d9ba53',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.369054] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.369269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.369269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.369486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.369666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.392095] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: IN_PROGRESS for 2s [ 630.496613] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.499019] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a7ebbf5-891b-4e9d-a214-eeb3c527335d with status ACTIVE [ 630.499019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.499019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.499019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.499019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.499920] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a7ebbf5-891b-4e9d-a214-eeb3c527335d is going to be updated. [ 630.505921] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.530332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.530507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.530556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.530761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.530900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.531084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7ebbf5-891b-4e9d-a214-eeb3c527335d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.663281] env[65511]: INFO networking_nsxv3.common.synchronization [req-781e0987-b66c-4de1-8d6d-2231c9e1ed79 req-168356e6-1702-4047-bc25-9636bdf5bbae tempest-VolumesAdminNegativeTest-1289069815 tempest-VolumesAdminNegativeTest-1289069815-project-member] Enqueued Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 630.664934] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 630.664934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.667036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.667036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.667367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.667367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.868847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.869188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.869188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.871359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.871556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.871623] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21617e99-a047-4e2c-86c4-2367a5d9ba53 already deleted. [ 630.871786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21617e99-a047-4e2c-86c4-2367a5d9ba53" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.009085] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.103452] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-31 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.103612] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-31" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.103735] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-31" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.104207] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-31" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.104466] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.104637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.104750] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.104985] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.105388] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.105388] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.105495] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.105531] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.105637] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.105734] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.105845] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.105971] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.126330] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.126484] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.126619] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.126797] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-31" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.127125] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.127297] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.127438] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.127795] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.127926] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0b65b7-8d21-42f9-ab19-a4ab5f09b852',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.169898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.170085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.170154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.170388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.170480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.170672] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.170902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.171067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.171267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.171347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.171442] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 already deleted. [ 631.171525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.488816] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 631.489099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.489277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.489599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.489758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.489899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.489982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.490204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.490303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.490404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.490495] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.513834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.514051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.514130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.514359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.514447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.514550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be created. [ 631.546023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.546274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.546274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.546482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.546644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.559190] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: UNINITIALIZED for 2s [ 631.630267] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.630754] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.630849] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.631139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.631283] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.631442] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 not found, creating... [ 631.631757] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.631966] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.632093] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.632328] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.632517] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.632834] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.632987] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.633108] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.633322] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.633485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.633622] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 is going to be created. [ 631.656813] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.657091] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.657091] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.657437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.657668] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.657893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.992873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.993227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.993227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.993444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.993611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.993717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.993844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.994050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.994144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.994238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.994419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.994526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.994604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.994811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.995110] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.995265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.995357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.995595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.995694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.995820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.995928] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.249904] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: SUCCESS [ 632.250184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.395293] env[65511]: INFO networking_nsxv3.common.synchronization [req-781e0987-b66c-4de1-8d6d-2231c9e1ed79 req-88f56e64-cf61-4038-854a-d094d3d21a68 service nova] Enqueued Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_rules [ 632.395506] env[65511]: INFO networking_nsxv3.common.synchronization [req-781e0987-b66c-4de1-8d6d-2231c9e1ed79 req-88f56e64-cf61-4038-854a-d094d3d21a68 service nova] Enqueued Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 632.396508] env[65511]: INFO networking_nsxv3.common.synchronization [req-781e0987-b66c-4de1-8d6d-2231c9e1ed79 req-88f56e64-cf61-4038-854a-d094d3d21a68 service nova] Enqueued Resource ID: 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 with Priority: HIGHEST for action port [ 632.396508] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_rules [ 632.396735] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 632.396735] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 with Priority: HIGHEST for action port [ 632.397751] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.397751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.397751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.397957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.398101] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.399562] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.399684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.399752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.399953] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.400134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.400239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.400302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.400897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.400897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.400897] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.401487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.401609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.405674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.405968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.408640] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0b65b7-8d21-42f9-ab19-a4ab5f09b852',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.413027] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: SUCCESS [ 632.413170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.502064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 232b7b09-b30d-4f2e-95a8-0315ce8667b1: rpc.has_security_group_logging(os_id): False [ 632.519815] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.519815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.519815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.519815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.519815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.520151] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.520151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.520151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.520309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.520357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.520575] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.520946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.520946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.520946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.520946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.521230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.521305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.521339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.521965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.521965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.521965] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be created. [ 632.596942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.597063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.597103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.597306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.597492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.618256] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 632.911160] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 with status ACTIVE [ 632.911217] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.911965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.911965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.911965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.911965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.911965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.912329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.912329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.912329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.912466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.912656] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.912778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.912843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.913022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.913111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.913199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b0b65b7-8d21-42f9-ab19-a4ab5f09b852 is going to be updated. [ 632.919871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.920089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.924722] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.948343] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.948483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.948655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.948774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.948968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.949460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b0b65b7-8d21-42f9-ab19-a4ab5f09b852" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.226466] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0f5bcf23-5a89-4bd1-be44-43006ec442a1 None None] Enqueued Resource ID: 2924f223-a8c3-4d80-9a57-94441b2273b5 with Priority: HIGHEST for action port [ 633.227219] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2924f223-a8c3-4d80-9a57-94441b2273b5 with Priority: HIGHEST for action port [ 633.229160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2924f223-a8c3-4d80-9a57-94441b2273b5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.229314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2924f223-a8c3-4d80-9a57-94441b2273b5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.229380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2924f223-a8c3-4d80-9a57-94441b2273b5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.230273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2924f223-a8c3-4d80-9a57-94441b2273b5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.230391] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2924f223-a8c3-4d80-9a57-94441b2273b5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.425154] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.571985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 633.572253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.572884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.573086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.573288] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.573399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.573465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.573628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.573705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.574169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.574357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.735111] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2924f223-a8c3-4d80-9a57-94441b2273b5 [ 633.735641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.735641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.735641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.735845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.735845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.735919] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2924f223-a8c3-4d80-9a57-94441b2273b5 already deleted. [ 633.736011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2924f223-a8c3-4d80-9a57-94441b2273b5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.793458] env[65511]: INFO networking_nsxv3.common.synchronization [req-5cad7036-df1e-4b71-b105-29012a776720 req-4ef236c4-03c8-46fa-84b0-be1958d6c23e tempest-ServerPasswordTestJSON-2016159458 tempest-ServerPasswordTestJSON-2016159458-project-member] Enqueued Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 633.794210] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 633.794536] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.794663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.794736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.795740] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.927672] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.927672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.927672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.927924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.927980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.928116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 is going to be created. [ 633.958830] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.958929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.959025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.959305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.959475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.971389] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: UNINITIALIZED for 2s [ 634.077542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.077687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.077832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.079035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.079035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.079035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.079545] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.079545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.079545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.079645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.079676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.080147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.080147] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.245935] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.245935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-212" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.245935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-212" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.247022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-212" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.247022] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.247022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.247559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.247559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.247675] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.247960] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.248172] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.248592] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.248592] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.248701] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.248827] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.248996] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.279525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.279976] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.280212] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.280416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-212" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.280768] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-efb017a7-6416-402f-839d-796dbe631721 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.280981] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.281126] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.281654] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.281654] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb017a7-6416-402f-839d-796dbe631721',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.298872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.301889] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.301889] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 already deleted. [ 634.301889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.584371] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95d278ea-5c85-431d-b2c5-e2b81a141e5f: rpc.has_security_group_logging(os_id): False [ 634.615649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.615801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.615867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.616766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.617027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.617704] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.617994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.618203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.618596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.619329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.620011] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.620190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.620293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.620888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.620888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.620888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.621232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.621232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.621326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.621403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.621784] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be created. [ 634.639637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 634.640052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.707542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.707542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.707542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.707542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.707829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.723895] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 634.784332] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.784856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.785035] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.785402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.785599] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.785790] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port efb017a7-6416-402f-839d-796dbe631721 not found, creating... [ 634.786137] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.786355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.786636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.786858] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.786993] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.787318] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.787481] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.787628] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.787927] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.788179] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.788272] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: efb017a7-6416-402f-839d-796dbe631721 is going to be created. [ 634.811113] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.811344] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.811461] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.811737] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.811987] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.814321] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.531830] env[65511]: INFO networking_nsxv3.common.synchronization [req-5cad7036-df1e-4b71-b105-29012a776720 req-57426a9e-0991-494a-87c6-adbddaf9e7da service nova] Enqueued Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_rules [ 635.532236] env[65511]: INFO networking_nsxv3.common.synchronization [req-5cad7036-df1e-4b71-b105-29012a776720 req-57426a9e-0991-494a-87c6-adbddaf9e7da service nova] Enqueued Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 635.532487] env[65511]: INFO networking_nsxv3.common.synchronization [req-5cad7036-df1e-4b71-b105-29012a776720 req-57426a9e-0991-494a-87c6-adbddaf9e7da service nova] Enqueued Resource ID: efb017a7-6416-402f-839d-796dbe631721 with Priority: HIGHEST for action port [ 635.537019] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_rules [ 635.537019] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 635.537019] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efb017a7-6416-402f-839d-796dbe631721 with Priority: HIGHEST for action port [ 635.537019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.537019] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.537019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.537019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.538135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.538385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.538451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.538664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.538759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.538913] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.540306] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-efb017a7-6416-402f-839d-796dbe631721 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.540440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.540504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.540766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.540827] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efb017a7-6416-402f-839d-796dbe631721',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.671513] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ad59f2e-47bb-4944-96c9-8438f4c3ed6a req-9d74a9a2-489f-4a1e-ae97-264e5c8298ca tempest-ServersV294TestFqdnHostnames-358523912 tempest-ServersV294TestFqdnHostnames-358523912-project-member] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 635.672403] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 635.672730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.672855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.672929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.673268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.673430] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.673533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.673595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.673750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.673990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.674128] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.846325] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e8f3f7a0-7130-4371-af09-badc9f97369f None None] Enqueued Resource ID: fa61ab40-a439-42be-9b05-c6c3b9810950 with Priority: HIGHEST for action port [ 635.846934] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa61ab40-a439-42be-9b05-c6c3b9810950 with Priority: HIGHEST for action port [ 635.847469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa61ab40-a439-42be-9b05-c6c3b9810950 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.848090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa61ab40-a439-42be-9b05-c6c3b9810950" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.848801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa61ab40-a439-42be-9b05-c6c3b9810950" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.848801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa61ab40-a439-42be-9b05-c6c3b9810950" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.849270] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa61ab40-a439-42be-9b05-c6c3b9810950',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.982842] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: SUCCESS [ 635.983083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.983357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.983509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.983964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.983964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.983964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.984338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.984338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.984475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.984676] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.042725] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.044164] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.044344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.044777] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efb017a7-6416-402f-839d-796dbe631721 with status ACTIVE [ 636.045020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.045190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.045266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.047730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.049239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.049445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.049556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.049623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.049813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.049895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.050130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.050231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.050294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.050449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.050542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.050637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efb017a7-6416-402f-839d-796dbe631721 is going to be updated. [ 636.053270] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-973 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.053430] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-973" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.053543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-973" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.053845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-973" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.054097] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.054269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.054377] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.054574] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.054696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.054916] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.055055] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.055162] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.055259] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.055360] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.055469] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.055600] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.080251] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.080251] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.080251] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.080251] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-973" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.080496] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.080496] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.080632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.081788] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.081788] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f00c0dd-a176-43ae-a2fc-6ddc42142b20',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.083334] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.083487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.083560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.084441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.084441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.084441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efb017a7-6416-402f-839d-796dbe631721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.178905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.179093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.179166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.179930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.179930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.179930] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.179930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.179930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.180236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.180236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.180236] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf already deleted. [ 636.180341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.351901] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa61ab40-a439-42be-9b05-c6c3b9810950 [ 636.352113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.352199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.352268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.352511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.352600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.352698] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa61ab40-a439-42be-9b05-c6c3b9810950 already deleted. [ 636.352927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa61ab40-a439-42be-9b05-c6c3b9810950" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.487740] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.487981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.488078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.488360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.488565] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.488673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.488734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.488894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.488982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.489125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.489223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.489314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.489371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.489512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.489646] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.489734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.489790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.490090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.490090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.490090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.490215] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.545997] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.585503] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.585733] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.585854] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.586181] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.589163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 not found, creating... [ 636.589163] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.589163] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.589163] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.589848] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.589848] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.589848] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 is going to be created. [ 636.611988] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.612145] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.612346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.612552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.612831] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.616165] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.742642] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 636.742642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.992423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad443118-3368-4228-ba77-45b8d1ef4512: rpc.has_security_group_logging(os_id): False [ 637.012632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.012845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.012990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.013397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.013559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.017209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.017380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.017465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.017721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.017854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.018152] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.018261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.018314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.018508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.018594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.018818] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.018939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.019016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.019169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.019246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.019332] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 is going to be created. [ 637.049121] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.049358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.049358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.049650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.049755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.049847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 is going to be created. [ 637.095942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.096287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.096414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.096745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.097108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.113501] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: UNINITIALIZED for 2s [ 637.118525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.118719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.118816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.119138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.119385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.134913] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: IN_PROGRESS for 2s [ 637.373092] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ad59f2e-47bb-4944-96c9-8438f4c3ed6a req-123d9f62-ad17-46be-8dc2-b2d056e0486a service nova] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 637.373260] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ad59f2e-47bb-4944-96c9-8438f4c3ed6a req-123d9f62-ad17-46be-8dc2-b2d056e0486a service nova] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 637.373395] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ad59f2e-47bb-4944-96c9-8438f4c3ed6a req-123d9f62-ad17-46be-8dc2-b2d056e0486a service nova] Enqueued Resource ID: 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 with Priority: HIGHEST for action port [ 637.373946] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_rules [ 637.374077] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 637.374169] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 with Priority: HIGHEST for action port [ 637.374436] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.374556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.374619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.374990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.374990] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.376448] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.376615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.376761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.376939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.377139] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.377191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.377251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.377396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.377482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.377656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.378434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.378544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.378609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.378759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.378836] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f00c0dd-a176-43ae-a2fc-6ddc42142b20',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.882324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.883310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.883549] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.885208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 with status ACTIVE [ 637.885208] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.886223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.888059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.888177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.888420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.888495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.888743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.888906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.889014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.890652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.890652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.890652] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f00c0dd-a176-43ae-a2fc-6ddc42142b20 is going to be updated. [ 637.917586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.917788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.917870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.918056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.918221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.918379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f00c0dd-a176-43ae-a2fc-6ddc42142b20" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.069823] env[65511]: INFO networking_nsxv3.common.synchronization [req-73f26617-6998-4078-9b07-22d11649ef24 req-640c76e7-42ec-4b6b-bf75-9e69a465679f tempest-FloatingIPsAssociationTestJSON-861519946 tempest-FloatingIPsAssociationTestJSON-861519946-project-member] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 638.069908] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 638.070783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.071025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.071169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.071493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.071711] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.071889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.072218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.073199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.073199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.073199] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.392203] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.473432] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-570 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.473632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.473733] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.474110] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.474368] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.474519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.474626] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.474841] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.474978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475352] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.475482] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.475570] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.475671] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.475772] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.475915] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.476141] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.497506] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.497506] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.497506] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.497506] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.497768] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-10ecd052-58f8-4a5f-abd8-befc26bae90b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.497914] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.498082] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.498856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.498856] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ecd052-58f8-4a5f-abd8-befc26bae90b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.579918] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.579918] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.579918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 already deleted. [ 638.579918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.895563] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.895904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.895904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.896048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.896603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.896847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf is going to be created. [ 638.926457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.926615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.926753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.926879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.927065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.945675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: UNINITIALIZED for 2s [ 639.001094] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.001352] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.001470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.001740] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.001891] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.002044] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 10ecd052-58f8-4a5f-abd8-befc26bae90b not found, creating... [ 639.002303] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.002591] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.002591] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.002848] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.002960] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.003284] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.003408] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.003522] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.004317] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.004404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.004488] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 10ecd052-58f8-4a5f-abd8-befc26bae90b is going to be created. [ 639.030028] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.030028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.030028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.030028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.030028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.031639] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.134832] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: SUCCESS [ 639.134999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.136098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.136233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.136425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.136538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.136604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.136760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.136980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.136980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137057] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.153462] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: SUCCESS [ 639.153698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.641765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.641765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.641765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.641765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.641765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.643196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.643196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.643196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.644534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.644534] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.826933] env[65511]: INFO networking_nsxv3.common.synchronization [req-73f26617-6998-4078-9b07-22d11649ef24 req-b46d084d-259e-4e56-b039-df8e41f0a086 service nova] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_rules [ 639.827157] env[65511]: INFO networking_nsxv3.common.synchronization [req-73f26617-6998-4078-9b07-22d11649ef24 req-b46d084d-259e-4e56-b039-df8e41f0a086 service nova] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 639.827305] env[65511]: INFO networking_nsxv3.common.synchronization [req-73f26617-6998-4078-9b07-22d11649ef24 req-b46d084d-259e-4e56-b039-df8e41f0a086 service nova] Enqueued Resource ID: 10ecd052-58f8-4a5f-abd8-befc26bae90b with Priority: HIGHEST for action port [ 639.827987] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_rules [ 639.828947] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 639.829204] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ecd052-58f8-4a5f-abd8-befc26bae90b with Priority: HIGHEST for action port [ 639.829529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.829706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.829784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.830112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.830215] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.831827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.831964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.832047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.832216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.832637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.832637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.832637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.832842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.832842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.833078] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.833972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ecd052-58f8-4a5f-abd8-befc26bae90b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.834171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.834171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.834362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.834495] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ecd052-58f8-4a5f-abd8-befc26bae90b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.147948] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968: rpc.has_security_group_logging(os_id): False [ 640.172445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.172445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.172445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.172445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.172970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.172970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.172970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.172970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.173432] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.173432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.173432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.173682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.173682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.173682] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 is going to be created. [ 640.242904] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.243105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.243257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.243485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.243980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.247431] env[65511]: INFO networking_nsxv3.common.synchronization [req-751a6317-b9f0-406e-b80d-d1f1b6020f69 req-f3138c13-a439-44b1-954b-82d570e9a9c5 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 640.248061] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 640.248372] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.248558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.248642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.248864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.249045] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.249185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.249245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.249355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.249439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.250173] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.254732] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: IN_PROGRESS for 2s [ 640.283557] env[65511]: INFO networking_nsxv3.common.synchronization [None req-4586beea-f06f-48cb-a219-bfea090e6744 tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 640.284059] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 640.284750] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.285054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.285054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.285490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.285604] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.336153] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.337099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.337099] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.337640] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10ecd052-58f8-4a5f-abd8-befc26bae90b with status ACTIVE [ 640.338075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.338075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.338075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.340968] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.340968] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.340968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.340968] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10ecd052-58f8-4a5f-abd8-befc26bae90b is going to be updated. [ 640.384639] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.384639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.384881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.387335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.387335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.387335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ecd052-58f8-4a5f-abd8-befc26bae90b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.405335] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ab508a35-404d-4d5c-aef3-7ce71617af07 tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 640.405453] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 640.407542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.407542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.722143] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.722143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.722143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.722143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.722402] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.722576] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.722668] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.723871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.723871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.723871] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.723871] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.723871] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.723871] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.723871] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.724172] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.724172] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.745384] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.745518] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.745926] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.746218] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.746543] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.746749] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.746920] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.747376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.747488] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0920e26f-70d8-4dc5-a4a0-ecf6082d107e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.752178] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.810538] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.810781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.810927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.811292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.811547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.811685] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 already deleted. [ 640.811888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.812279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.812498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.812777] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.842916] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.959610] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: SUCCESS [ 640.959911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.960036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.960280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.960528] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.960757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.960757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.960948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.961056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.961176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.961310] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.204609] env[65511]: INFO networking_nsxv3.common.synchronization [req-22c8459b-67f3-444a-b4b8-ae365452d838 req-6ab02114-76a0-46e1-b293-be32e963de2c tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: e6370a84-c284-401f-a80b-560e4d62cf2d with Priority: HIGHEST for action security_group_rules [ 641.205299] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6370a84-c284-401f-a80b-560e4d62cf2d with Priority: HIGHEST for action security_group_rules [ 641.206290] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6370a84-c284-401f-a80b-560e4d62cf2d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.206487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6370a84-c284-401f-a80b-560e4d62cf2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.206546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6370a84-c284-401f-a80b-560e4d62cf2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.206860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6370a84-c284-401f-a80b-560e4d62cf2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.206972] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6370a84-c284-401f-a80b-560e4d62cf2d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.250762] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.250762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.250762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.250762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.250762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.250762] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 0920e26f-70d8-4dc5-a4a0-ecf6082d107e not found, creating... [ 641.250762] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.251188] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.251188] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.251266] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.251327] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.251594] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.251733] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.251904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.252115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.252242] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.252685] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 0920e26f-70d8-4dc5-a4a0-ecf6082d107e is going to be created. [ 641.253963] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.276681] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.276934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.277474] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.277474] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.277928] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.277928] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.338450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.338825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.338825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.338990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.338990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.339310] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 already deleted. [ 641.339310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.345952] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.346298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.346298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.346513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.346568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.346663] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be created. [ 641.405512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.405695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.405730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.405946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.406140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.421824] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: UNINITIALIZED for 2s [ 641.466371] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.556781] env[65511]: INFO networking_nsxv3.common.synchronization [req-7dab53b8-7231-42ba-8d5d-3d7ef088696d req-21c44b68-59fe-4576-b8c3-128e2a8dd54a tempest-DeleteServersAdminTestJSON-311304329 tempest-DeleteServersAdminTestJSON-311304329-project-admin] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 641.556781] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 641.556781] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.556781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.556781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.557171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.557171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.557251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.557285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.557453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.557583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.557638] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.732072] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.732072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.732072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.732072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.732376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.732376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6370a84-c284-401f-a80b-560e4d62cf2d already deleted. [ 641.732376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6370a84-c284-401f-a80b-560e4d62cf2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.757922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.758094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.758137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.758413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.758511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.758554] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 641.808860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.809128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.809128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.809352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.809539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.821052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 641.967782] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf: rpc.has_security_group_logging(os_id): False [ 641.986316] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.986316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.986316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.986522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.986522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.986729] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.986816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.986880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.987045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.987121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.987203] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf is going to be created. [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [req-751a6317-b9f0-406e-b80d-d1f1b6020f69 req-d2c29443-0455-4084-9209-5f919f71e28e service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [req-751a6317-b9f0-406e-b80d-d1f1b6020f69 req-d2c29443-0455-4084-9209-5f919f71e28e service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [req-751a6317-b9f0-406e-b80d-d1f1b6020f69 req-d2c29443-0455-4084-9209-5f919f71e28e service nova] Enqueued Resource ID: 0920e26f-70d8-4dc5-a4a0-ecf6082d107e with Priority: HIGHEST for action port [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 642.022500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0920e26f-70d8-4dc5-a4a0-ecf6082d107e with Priority: HIGHEST for action port [ 642.022500] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.023332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.023332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.023332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.023332] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.024039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.024154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.024342] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.024496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.024562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.024726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.024794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0920e26f-70d8-4dc5-a4a0-ecf6082d107e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.055300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.055450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.055521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.055754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.055957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.060514] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.060514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.060728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.060786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.060879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.061113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.061216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.061273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.061715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.061715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.061715] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be updated. [ 642.072539] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: IN_PROGRESS for 2s [ 642.100288] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.100560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.100560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.100805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.100995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.114408] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 642.268940] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: SUCCESS [ 642.268940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.527050] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.527281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.527497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0920e26f-70d8-4dc5-a4a0-ecf6082d107e with status ACTIVE [ 642.527749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.527879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.527948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.528344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.528513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.528763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.528933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.529088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.529242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.529350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.529567] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.529653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.529878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.529956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.530032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.530163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0920e26f-70d8-4dc5-a4a0-ecf6082d107e is going to be updated. [ 642.554191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.554357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.554979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.556225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.556478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.556788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0920e26f-70d8-4dc5-a4a0-ecf6082d107e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.048825] env[65511]: INFO networking_nsxv3.common.synchronization [req-c6bb0b6d-25ed-4230-9afb-bceb1d2ab8f4 req-fc2f51af-18d2-4fab-90ef-6bd9743a11c5 tempest-VolumesAssistedSnapshotsTest-1228276739 tempest-VolumesAssistedSnapshotsTest-1228276739-project-member] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 643.048825] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 643.048825] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.048962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.048962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.050813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.050813] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.050813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.050813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.050813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.050813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.050813] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.439528] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 643.439528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.439528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.440013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.440013] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.441430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.441430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.441430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.441430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.441430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.441430] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.554106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.554347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.554467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.554791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.555036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.555352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.555522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.555755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.555954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.556089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.556208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 already deleted. [ 643.556366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.689353] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.689353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-554" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.689353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-554" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.690058] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-554" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.690583] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.690957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.691323] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.691844] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.692448] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.692837] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.693520] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.694156] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.694655] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.695746] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.695746] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.695746] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.718468] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.718590] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.718724] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.718895] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-554" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.719230] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.719405] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.719549] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.720404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.720546] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e283df6-7c9d-409f-8a4b-5d6168e9eed5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.831952] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 643.832850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.833469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.833696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.833886] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.834040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.834110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.834274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.834365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.834453] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.944773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.944975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.945120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.945464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.945747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.945914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.945990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.946201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.946291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.946544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.946544] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.946937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.946937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.946937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.947329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.947955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.948091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.948339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.948478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.948619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.948784] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.090128] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: SUCCESS [ 644.090411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.129023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 644.129023] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 deletion is rescheduled due to dependency. [ 644.129023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.222975] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.223305] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.223424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.223768] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.224022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.224199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 not found, creating... [ 644.224576] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.224694] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.224851] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.225170] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.225271] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.225960] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.226191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.226339] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.226551] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.226678] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.226814] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 is going to be created. [ 644.247135] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.247365] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.247486] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.247756] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.248009] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.248280] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.337297] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.452707] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 264b2244-7780-4186-84f6-37be29843260: rpc.has_security_group_logging(os_id): False [ 644.474857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.474857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.474857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.474857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.475600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.475600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.475908] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be created. [ 644.552874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.552874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.552874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.553079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.553979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.578669] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 644.840212] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.967584] env[65511]: INFO networking_nsxv3.common.synchronization [req-c6bb0b6d-25ed-4230-9afb-bceb1d2ab8f4 req-9f961729-78d0-4c81-b78d-44e955ab36e8 service nova] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 644.968510] env[65511]: INFO networking_nsxv3.common.synchronization [req-c6bb0b6d-25ed-4230-9afb-bceb1d2ab8f4 req-9f961729-78d0-4c81-b78d-44e955ab36e8 service nova] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 644.968510] env[65511]: INFO networking_nsxv3.common.synchronization [req-c6bb0b6d-25ed-4230-9afb-bceb1d2ab8f4 req-9f961729-78d0-4c81-b78d-44e955ab36e8 service nova] Enqueued Resource ID: 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 with Priority: HIGHEST for action port [ 644.968510] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_rules [ 644.968714] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 644.968868] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 with Priority: HIGHEST for action port [ 644.969427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.969625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.969732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.970053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.970204] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.971512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.972509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.972509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.972509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.972509] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.972509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.972761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.972877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.973058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.973234] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.974856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.974856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.974856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.974998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.975050] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e283df6-7c9d-409f-8a4b-5d6168e9eed5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.993718] env[65511]: INFO networking_nsxv3.common.synchronization [req-926c3148-8b7e-4707-a5fd-c7b2f793cf88 req-f9d5da23-b392-4517-b6f5-31b392d20fe9 tempest-ImagesNegativeTestJSON-121071014 tempest-ImagesNegativeTestJSON-121071014-project-member] Enqueued Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 644.993718] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGHEST for action security_group_members [ 644.993718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.993718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.993718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.993718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.994888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.994888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.994888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.994888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.994888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.995833] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.343558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.344144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.344392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.345052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.345052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.345052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 645.379410] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.379581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.379646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.379874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.380040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.393892] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 645.483495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.483495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.483495] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.483495] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 with status ACTIVE [ 645.483495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.484216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.484216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.484216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.484312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.484610] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.484740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.484740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.484917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.485065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.485515] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.485515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.485515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.485515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.485697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.485697] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e283df6-7c9d-409f-8a4b-5d6168e9eed5 is going to be updated. [ 645.499433] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.499636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.500076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.500433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.500565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.500840] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.501380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.501755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.501755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.501755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.501999] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb is going to be updated. [ 645.523242] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.523242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.523242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.523531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.524142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.524142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e283df6-7c9d-409f-8a4b-5d6168e9eed5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.541039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.541039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.541039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.541039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.541039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.553275] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: IN_PROGRESS for 2s [ 645.988113] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.491159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.491159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.491159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.491159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.491159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.491665] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 is going to be created. [ 646.523253] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.523253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.523253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.523253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.523253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.536248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: UNINITIALIZED for 2s [ 646.599038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 646.599038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.643831] env[65511]: INFO networking_nsxv3.common.synchronization [req-78237668-051d-4035-9ca9-6425c39fa462 req-25f022ab-e17f-4b4c-bddf-6027c5ab989c tempest-ServerDiagnosticsNegativeTest-2147345831 tempest-ServerDiagnosticsNegativeTest-2147345831-project-member] Enqueued Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 646.644488] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 646.645754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.645754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.645754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.645754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.645754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.645754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.645754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.646401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.646401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646401] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.150345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.150345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.150345] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a already deleted. [ 647.150345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.178156] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.178156] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.178156] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.179376] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.179849] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.180499] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.180785] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.181528] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.181528] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.181528] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.204818] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.205026] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.205276] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.205375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.205703] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-38cebae3-0c12-4e53-ab21-2b0d6b31229c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.205882] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.205999] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.207781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.207781] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38cebae3-0c12-4e53-ab21-2b0d6b31229c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.412334] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 647.412534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.412719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.412943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.413217] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.413343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.413408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.413636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.413684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.413751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.413874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.569637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 591b3b3b-b754-4346-a3c6-b62daea076eb in Status: SUCCESS [ 647.571262] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb deletion is rescheduled due to dependency. [ 647.571262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.709382] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.709632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.710071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.710493] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.710692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.710968] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 38cebae3-0c12-4e53-ab21-2b0d6b31229c not found, creating... [ 647.711289] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.711531] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.711807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.712046] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.712875] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.712875] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.712875] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.712875] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.713183] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.713376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.713538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 38cebae3-0c12-4e53-ab21-2b0d6b31229c is going to be created. [ 647.744048] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.744048] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.744048] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.744434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.744434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.744677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.916991] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.917808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.917970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.918404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.918645] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.918784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.918854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.919061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.919153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.919257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.919441] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.919542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.919602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.919761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.919912] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.920019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.920081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.920231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.920317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.920401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.920489] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.423241] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95d278ea-5c85-431d-b2c5-e2b81a141e5f: rpc.has_security_group_logging(os_id): False [ 648.443798] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.444057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.444126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.444722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.444722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.444913] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.444990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.445122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446045] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.446045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446406] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.446406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.446406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.446406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.446598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.446598] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 648.468110] env[65511]: INFO networking_nsxv3.common.synchronization [req-78237668-051d-4035-9ca9-6425c39fa462 req-e86cf712-0135-4545-ab80-9193d2286cbb service nova] Enqueued Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_rules [ 648.468684] env[65511]: INFO networking_nsxv3.common.synchronization [req-78237668-051d-4035-9ca9-6425c39fa462 req-e86cf712-0135-4545-ab80-9193d2286cbb service nova] Enqueued Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 648.468684] env[65511]: INFO networking_nsxv3.common.synchronization [req-78237668-051d-4035-9ca9-6425c39fa462 req-e86cf712-0135-4545-ab80-9193d2286cbb service nova] Enqueued Resource ID: 38cebae3-0c12-4e53-ab21-2b0d6b31229c with Priority: HIGHEST for action port [ 648.469179] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_rules [ 648.469393] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 648.469562] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38cebae3-0c12-4e53-ab21-2b0d6b31229c with Priority: HIGHEST for action port [ 648.469900] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.470100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.470374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.470417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.470583] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.472049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.472049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.472049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.472481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.472834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.475041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.475161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.475463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.475634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.475765] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.477135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-38cebae3-0c12-4e53-ab21-2b0d6b31229c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.477135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.477135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.477758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.477758] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38cebae3-0c12-4e53-ab21-2b0d6b31229c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.526624] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.526916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.526916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.527111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.527239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.547931] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 648.548244] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: SUCCESS [ 648.548545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.548707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.548941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.549268] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.549455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.549524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.549744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.549822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.550433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.551114] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.979045] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.980129] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.980274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.980444] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38cebae3-0c12-4e53-ab21-2b0d6b31229c with status ACTIVE [ 648.980747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.980874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.980874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.981128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.981236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.981458] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.981567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.981650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.981847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.981941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.982335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.982495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.982533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.982711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.982879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.982954] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38cebae3-0c12-4e53-ab21-2b0d6b31229c is going to be updated. [ 649.021717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.021717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.021717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.022607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.022607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.022607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38cebae3-0c12-4e53-ab21-2b0d6b31229c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.054325] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.488453] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.555611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 897a9691-2826-4bf1-8977-6d7594c8df89: rpc.has_security_group_logging(os_id): False [ 649.579212] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.579398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.579498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.579715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.579857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.580167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.580354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.580354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.580565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.580656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.580786] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 is going to be created. [ 649.650787] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.651478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.651478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.651478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.651478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.664365] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: IN_PROGRESS for 2s [ 649.848369] env[65511]: INFO networking_nsxv3.common.synchronization [req-738e1016-d551-4ef9-944f-a4660114ff51 req-9bd6d55b-4542-445b-b813-ae193abdd43c tempest-ServerExternalEventsTest-104113178 tempest-ServerExternalEventsTest-104113178-project-member] Enqueued Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 649.849135] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b with Priority: HIGHEST for action security_group_members [ 649.849606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d28d366-53ef-44cf-aae9-28a5d620d19b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.849770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.849770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.849976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.850219] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.850340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.850738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.850738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.850949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.850949] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d28d366-53ef-44cf-aae9-28a5d620d19b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.991487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.991907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.991907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.992256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.992407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.992573] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a is going to be created. [ 650.031353] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.031494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.031557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.031864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.033232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.048836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: UNINITIALIZED for 2s [ 650.354145] env[65511]: INFO networking_nsxv3.common.synchronization [None req-93c17dc7-1543-40c2-b0b0-63f63e0cc5a2 None None] Enqueued Resource ID: 9a164e8a-f2e8-4970-8f1f-49810d3f54e7 with Priority: HIGHEST for action port [ 650.354522] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.354522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.354522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.354689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.354689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.355055] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.355055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.355055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.355883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.355883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.355883] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b is going to be updated. [ 650.356898] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a164e8a-f2e8-4970-8f1f-49810d3f54e7 with Priority: HIGHEST for action port [ 650.357238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a164e8a-f2e8-4970-8f1f-49810d3f54e7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.357379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a164e8a-f2e8-4970-8f1f-49810d3f54e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.357420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a164e8a-f2e8-4970-8f1f-49810d3f54e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.357750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a164e8a-f2e8-4970-8f1f-49810d3f54e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.357750] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a164e8a-f2e8-4970-8f1f-49810d3f54e7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.392802] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.392802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.392802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.392802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.392802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.411182] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: IN_PROGRESS for 2s [ 650.565687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 650.566638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.860805] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a164e8a-f2e8-4970-8f1f-49810d3f54e7 [ 650.861232] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.861443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.861799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.862105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.862326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.862451] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a164e8a-f2e8-4970-8f1f-49810d3f54e7 already deleted. [ 650.862615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a164e8a-f2e8-4970-8f1f-49810d3f54e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.360022] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5e0640da-7e72-40c9-a5bd-bc33f63aeae7 None None] Enqueued Resource ID: 267a8410-9cf1-445d-8dbb-60c8fe8fef48 with Priority: HIGHEST for action port [ 651.360022] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 267a8410-9cf1-445d-8dbb-60c8fe8fef48 with Priority: HIGHEST for action port [ 651.360022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-267a8410-9cf1-445d-8dbb-60c8fe8fef48 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.360022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-267a8410-9cf1-445d-8dbb-60c8fe8fef48" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.360022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-267a8410-9cf1-445d-8dbb-60c8fe8fef48" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.363107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-267a8410-9cf1-445d-8dbb-60c8fe8fef48" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.363107] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267a8410-9cf1-445d-8dbb-60c8fe8fef48',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.502053] env[65511]: INFO networking_nsxv3.common.synchronization [req-0a7f917d-1af2-4631-9f45-da1b0d78a3f5 req-9614a613-7ca4-4372-8d49-7b01d80aaaa0 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 651.502053] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 651.502053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.502053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.502053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.502053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.502053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.502053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.502377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.503961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.503961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.503961] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.681029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: SUCCESS [ 651.681029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.868094] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 267a8410-9cf1-445d-8dbb-60c8fe8fef48 [ 651.868608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.868754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.868826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.869059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.869157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.869254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:267a8410-9cf1-445d-8dbb-60c8fe8fef48 already deleted. [ 651.869332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-267a8410-9cf1-445d-8dbb-60c8fe8fef48" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.007812] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.007812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.007812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.007812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.007812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.008161] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.008161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.008161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.008365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.008434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.008525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c already deleted. [ 652.008609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.062402] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: SUCCESS [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.062402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.062402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.063036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.063036] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.255400] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.256143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.256601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.257470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.257772] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.257983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.258142] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.258419] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.258587] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.258797] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.258906] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.259046] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.259120] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.259222] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.259650] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.259650] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.285495] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.285663] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.285791] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.285969] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.286350] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.286532] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.286640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.286970] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.287110] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2404acc7-dfde-4d85-9ed0-a713d0f1ce78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.421778] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b in Status: SUCCESS [ 652.422063] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d28d366-53ef-44cf-aae9-28a5d620d19b deletion is rescheduled due to dependency. [ 652.422199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d28d366-53ef-44cf-aae9-28a5d620d19b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.567748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.568848] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.568848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569229] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.569229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.569229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.569376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.569489] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.569580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.569639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.569779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.569868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.570070] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.792589] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.797024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 not found, creating... [ 652.797024] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.797024] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.797571] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.797860] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.798103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.798412] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.798808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.801774] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 is going to be created. [ 652.827560] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.827560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.827560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.827560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.827560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.827560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.939022] env[65511]: INFO networking_nsxv3.common.synchronization [None req-91c2710d-b978-4d8c-ac05-768a5c30d214 None None] Enqueued Resource ID: aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6 with Priority: HIGHEST for action port [ 652.939022] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6 with Priority: HIGHEST for action port [ 652.939022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.939022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.939022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.941092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.944881] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.072996] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 741f5f8c-49a5-4265-ad93-44b10c8b3e1a: rpc.has_security_group_logging(os_id): False [ 653.097027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.097027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.097027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.097027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.097765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.098068] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.098284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.098432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.098682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.098851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.099028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a is going to be created. [ 653.182044] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.182044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.182044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.182044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.182044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.193658] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: IN_PROGRESS for 2s [ 653.203065] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9ecb6032-9df7-4a1f-9b16-b9acfd4bfc17 None None] Enqueued Resource ID: 19a08714-84d6-412c-9773-79cfd9e49d58 with Priority: HIGHEST for action port [ 653.203619] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a08714-84d6-412c-9773-79cfd9e49d58 with Priority: HIGHEST for action port [ 653.203954] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-19a08714-84d6-412c-9773-79cfd9e49d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.204160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19a08714-84d6-412c-9773-79cfd9e49d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.204160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19a08714-84d6-412c-9773-79cfd9e49d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.204614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19a08714-84d6-412c-9773-79cfd9e49d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.204614] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19a08714-84d6-412c-9773-79cfd9e49d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.446349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6 [ 653.446629] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.447478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.447478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.447478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.447478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.447478] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6 already deleted. [ 653.447478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aefe4bf7-0f5d-4cb4-89b5-c4b00aabe8b6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.574446] env[65511]: INFO networking_nsxv3.common.synchronization [req-0a7f917d-1af2-4631-9f45-da1b0d78a3f5 req-744ab151-1469-466c-a304-264f856134e2 service nova] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 653.574446] env[65511]: INFO networking_nsxv3.common.synchronization [req-0a7f917d-1af2-4631-9f45-da1b0d78a3f5 req-744ab151-1469-466c-a304-264f856134e2 service nova] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 653.574446] env[65511]: INFO networking_nsxv3.common.synchronization [req-0a7f917d-1af2-4631-9f45-da1b0d78a3f5 req-744ab151-1469-466c-a304-264f856134e2 service nova] Enqueued Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 653.574740] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 653.574966] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 653.575256] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 653.575641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.575820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.575931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.576290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.576423] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.578045] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.578759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.578759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.578759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.579935] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.579935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.579935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.579935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.579935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.579935] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.582270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.582443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.582567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.585408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.585408] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2404acc7-dfde-4d85-9ed0-a713d0f1ce78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.706156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19a08714-84d6-412c-9773-79cfd9e49d58 [ 653.706452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.706756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.706756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.706971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.707089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.707193] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19a08714-84d6-412c-9773-79cfd9e49d58 already deleted. [ 653.707352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19a08714-84d6-412c-9773-79cfd9e49d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.926875] env[65511]: INFO networking_nsxv3.common.synchronization [req-89884fd6-8e5c-4d01-b256-c2b989c884d7 req-67f9adf6-1588-438d-933e-db83fbceb0d9 tempest-InstanceActionsNegativeTestJSON-21442914 tempest-InstanceActionsNegativeTestJSON-21442914-project-member] Enqueued Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 653.927430] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 653.927726] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.927846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.927909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.932128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.932128] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.932128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.932128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.932128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.932128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.932128] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.078696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.080898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.082527] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.088095] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with status ACTIVE [ 654.088490] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.088490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.088648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.088755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.088844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.089041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.089141] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.089202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.089368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.089444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.089619] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.089707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.089765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.089903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.089973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.090066] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 is going to be updated. [ 654.114145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.114410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.114410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.114592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.114732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.114899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.388009] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-626 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.388217] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-626" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.388337] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-626" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.388665] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-626" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.390026] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.390026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.390026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.390026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.390257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.390292] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.390415] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.390518] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.390620] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.390726] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.392908] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.392908] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.412962] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.413281] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.413281] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.413463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-626" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.413770] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3eb67403-6e86-4b83-bf19-51d73a1d910d taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.413945] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.414094] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.414404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.414534] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eb67403-6e86-4b83-bf19-51d73a1d910d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.431885] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.433453] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.433453] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9441a081-4c23-4898-9876-4df61d261ed0 already deleted. [ 654.433453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.586808] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.919631] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.919890] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.920093] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.920406] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.920549] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.920697] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3eb67403-6e86-4b83-bf19-51d73a1d910d not found, creating... [ 654.920960] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.921172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.921269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.921536] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.921618] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.921907] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.922272] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.922462] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.922690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.922825] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.923157] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3eb67403-6e86-4b83-bf19-51d73a1d910d is going to be created. [ 654.948711] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.948920] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.949050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.949331] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.949563] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.949788] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.090773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.090939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.091012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.091304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.091406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.091556] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be created. [ 655.117369] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.117369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.117588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.117645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.117811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.128903] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: UNINITIALIZED for 2s [ 655.208687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: SUCCESS [ 655.209022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.233927] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f2a3e3f2-eb9e-442f-b339-be6686112b66 None None] Enqueued Resource ID: ec20c5f9-8973-4b67-8aa4-95abed7005c4 with Priority: HIGHEST for action port [ 655.234559] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec20c5f9-8973-4b67-8aa4-95abed7005c4 with Priority: HIGHEST for action port [ 655.235712] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec20c5f9-8973-4b67-8aa4-95abed7005c4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.235712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec20c5f9-8973-4b67-8aa4-95abed7005c4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.235712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec20c5f9-8973-4b67-8aa4-95abed7005c4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.235712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec20c5f9-8973-4b67-8aa4-95abed7005c4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.235712] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec20c5f9-8973-4b67-8aa4-95abed7005c4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.286315] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6533a12f-dc19-4417-a731-ffba0588d3e4 None None] Enqueued Resource ID: f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732 with Priority: HIGHEST for action port [ 655.286848] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732 with Priority: HIGHEST for action port [ 655.287175] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.287305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.287365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.287619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.287699] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.686836] env[65511]: INFO networking_nsxv3.common.synchronization [req-89884fd6-8e5c-4d01-b256-c2b989c884d7 req-4fb02819-286d-4d24-96e4-68c0fb180906 service nova] Enqueued Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_rules [ 655.687228] env[65511]: INFO networking_nsxv3.common.synchronization [req-89884fd6-8e5c-4d01-b256-c2b989c884d7 req-4fb02819-286d-4d24-96e4-68c0fb180906 service nova] Enqueued Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 655.687316] env[65511]: INFO networking_nsxv3.common.synchronization [req-89884fd6-8e5c-4d01-b256-c2b989c884d7 req-4fb02819-286d-4d24-96e4-68c0fb180906 service nova] Enqueued Resource ID: 3eb67403-6e86-4b83-bf19-51d73a1d910d with Priority: HIGHEST for action port [ 655.688387] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_rules [ 655.688387] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 655.688387] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb67403-6e86-4b83-bf19-51d73a1d910d with Priority: HIGHEST for action port [ 655.688849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.690485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.690485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.690485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.690485] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.692392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.692827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.692827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.692827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.692986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.694276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.694276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.694276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.694276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.694276] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.696720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eb67403-6e86-4b83-bf19-51d73a1d910d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.696720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.696720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.696720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.696720] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eb67403-6e86-4b83-bf19-51d73a1d910d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.738293] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec20c5f9-8973-4b67-8aa4-95abed7005c4 [ 655.742181] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.742181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.742181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.742181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.742181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.742181] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec20c5f9-8973-4b67-8aa4-95abed7005c4 already deleted. [ 655.742181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec20c5f9-8973-4b67-8aa4-95abed7005c4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732 [ 655.794348] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.794348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.794348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.794348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.794348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732 already deleted. [ 655.794348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48bbce8-4a6f-44d6-bbaa-2b56a3c5b732" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.197531] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.197531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.197531] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.201022] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eb67403-6e86-4b83-bf19-51d73a1d910d with status ACTIVE [ 656.201022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.201022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.201022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.201591] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.201591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.201591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.201591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.201591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.201833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eb67403-6e86-4b83-bf19-51d73a1d910d is going to be updated. [ 656.230110] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.230300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.230345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.231603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.231603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.231603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eb67403-6e86-4b83-bf19-51d73a1d910d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.655476] env[65511]: INFO networking_nsxv3.common.synchronization [None req-931630b0-9251-4faa-ab1e-2e1d180894bc None None] Enqueued Resource ID: ec066575-b99a-4f3e-a590-2dddec1261b9 with Priority: HIGHEST for action port [ 656.656144] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec066575-b99a-4f3e-a590-2dddec1261b9 with Priority: HIGHEST for action port [ 656.656861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec066575-b99a-4f3e-a590-2dddec1261b9 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.656861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec066575-b99a-4f3e-a590-2dddec1261b9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.656861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec066575-b99a-4f3e-a590-2dddec1261b9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.662104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec066575-b99a-4f3e-a590-2dddec1261b9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.662104] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec066575-b99a-4f3e-a590-2dddec1261b9',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.704361] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.143034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 657.143175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.143386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.143758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.143996] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.144324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.144432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.144702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.144835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.144977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.145232] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.168248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec066575-b99a-4f3e-a590-2dddec1261b9 [ 657.168248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.168248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.168529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.168583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.168710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.168823] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec066575-b99a-4f3e-a590-2dddec1261b9 already deleted. [ 657.169088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec066575-b99a-4f3e-a590-2dddec1261b9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.209434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.209434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.209434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.209434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.209856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.209856] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9441a081-4c23-4898-9876-4df61d261ed0 is going to be created. [ 657.251658] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.253529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.253974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.253974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.254345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.271699] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: UNINITIALIZED for 2s [ 657.452941] env[65511]: INFO networking_nsxv3.common.synchronization [req-19621a8f-7088-45fe-8db4-1a19bc86c63e req-c56bd926-c296-446e-a4f1-fbaf02c3adda tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: 79351043-2e58-4845-a520-8ec7e22ad8ed with Priority: HIGHEST for action security_group_rules [ 657.454174] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79351043-2e58-4845-a520-8ec7e22ad8ed with Priority: HIGHEST for action security_group_rules [ 657.454696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79351043-2e58-4845-a520-8ec7e22ad8ed taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.456508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79351043-2e58-4845-a520-8ec7e22ad8ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.456508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79351043-2e58-4845-a520-8ec7e22ad8ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.456508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79351043-2e58-4845-a520-8ec7e22ad8ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.456508] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79351043-2e58-4845-a520-8ec7e22ad8ed',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.649922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.651296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.651296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.651441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.652763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.652978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.653534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.653972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.654547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.655131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.655473] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.658466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.658683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.659229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.659631] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.659862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.660013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.660303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.660688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.660688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.661268] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.978632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.979606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.979606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.979606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.979606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.979606] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79351043-2e58-4845-a520-8ec7e22ad8ed already deleted. [ 657.979606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79351043-2e58-4845-a520-8ec7e22ad8ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.078765] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d8b418ed-bf58-4689-82a2-1757c5c4d566 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 658.079233] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 658.079846] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.080039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.080143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.080429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.080554] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.167211] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 658.193194] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.193194] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.193194] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.193194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.193882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.193882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.194206] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be created. [ 658.287299] env[65511]: INFO networking_nsxv3.common.synchronization [None req-4d92c8d6-9037-440c-9b02-ecd98b22bf48 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 658.288879] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.289096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.289096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.290391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.290391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.291139] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 658.291472] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.292396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.332583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 658.607022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.607107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.607210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.608920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.609063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.609385] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e already deleted. [ 658.609385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.609507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.610042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.610178] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.140246] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.140608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.140608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.140754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.140805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.140991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e already deleted. [ 659.140991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.288995] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: SUCCESS [ 659.288995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.288995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.290545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.290545] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.293561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.293663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.294737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.294737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.294737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.294737] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.447871] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8b2d1b39-c1ae-4e99-becf-fcb12b8494c1 None None] Enqueued Resource ID: 85145753-a15a-4726-8eb4-c49c52b991e4 with Priority: HIGHEST for action port [ 659.448608] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85145753-a15a-4726-8eb4-c49c52b991e4 with Priority: HIGHEST for action port [ 659.449346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-85145753-a15a-4726-8eb4-c49c52b991e4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.450522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85145753-a15a-4726-8eb4-c49c52b991e4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.450638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85145753-a15a-4726-8eb4-c49c52b991e4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.450967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85145753-a15a-4726-8eb4-c49c52b991e4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.451247] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85145753-a15a-4726-8eb4-c49c52b991e4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.800164] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.800329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.800396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.800655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.800866] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.800994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.800994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.801175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.801277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.801378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.801780] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.801780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.801780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.801930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.802020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.802117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.802179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.802311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.802418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.802471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.802563] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.954681] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85145753-a15a-4726-8eb4-c49c52b991e4 [ 659.954681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.954681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.954681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.954681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.954681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.954681] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85145753-a15a-4726-8eb4-c49c52b991e4 already deleted. [ 659.954681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85145753-a15a-4726-8eb4-c49c52b991e4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.307427] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9441a081-4c23-4898-9876-4df61d261ed0: rpc.has_security_group_logging(os_id): False [ 660.316199] env[65511]: INFO networking_nsxv3.common.synchronization [req-91730d1c-f8e3-4ecd-9a0a-d9bdd54224a9 req-21cf78b7-2a02-40f8-aa6c-fdcee6f8d194 tempest-VolumesAdminNegativeTest-1289069815 tempest-VolumesAdminNegativeTest-1289069815-project-member] Enqueued Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 660.316936] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGHEST for action security_group_members [ 660.317468] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.317468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.317630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.317722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.317978] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.318135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.318307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.318541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.318909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.318909] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.351776] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.352030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.352030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.352533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.352533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.352906] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.352906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.352906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.353098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.353098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.353385] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.353478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.353478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.353644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.353743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.356623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.357026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.357160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.357588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.357863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.358058] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9441a081-4c23-4898-9876-4df61d261ed0 is going to be created. [ 660.362066] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 660.362812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.476031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.476031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.488933] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: IN_PROGRESS for 2s [ 660.821323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.821634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.821634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.821793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.822154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.822718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.822718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.822718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.822718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.823238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.823238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 is going to be updated. [ 660.872271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.872271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.872271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.872589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.872650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.891269] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: IN_PROGRESS for 2s [ 662.166814] env[65511]: INFO networking_nsxv3.common.synchronization [req-46795621-054c-4cb5-aef8-cf03577efc33 req-2c2c9a5b-7ec7-4a7a-9e3a-bda2eabc58ec tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 662.168392] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 662.169172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.169172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.169172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.169343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.169474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.169589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.169631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.169838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.169891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.169977] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.504327] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: SUCCESS [ 662.504906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.653027] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.653027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.653027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.654266] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.654266] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.657023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.657023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.657023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.657023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.657023] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.657023] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.657023] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.657023] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.657023] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.657023] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.657023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.674749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.674749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.674749] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 already deleted. [ 662.674749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.683286] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.683286] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.683286] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.683286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.683286] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.683286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.683286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.683286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.683286] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96fe2a9-82cf-4a2c-a721-4344f26f0d83',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.902826] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad443118-3368-4228-ba77-45b8d1ef4512 in Status: SUCCESS [ 662.902826] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 deletion is rescheduled due to dependency. [ 662.902826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.186613] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.186613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.186967] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.187014] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.187186] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.187406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port f96fe2a9-82cf-4a2c-a721-4344f26f0d83 not found, creating... [ 663.188160] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.188160] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.188160] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.188593] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.188754] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.189158] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.189318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.189428] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.191943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.191943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.191943] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: f96fe2a9-82cf-4a2c-a721-4344f26f0d83 is going to be created. [ 663.242352] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.243246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.243377] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.243730] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.243980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.244303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.909956] env[65511]: INFO networking_nsxv3.common.synchronization [req-46795621-054c-4cb5-aef8-cf03577efc33 req-47f2ea12-57de-492b-8989-e32c8c723d20 service nova] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 663.910192] env[65511]: INFO networking_nsxv3.common.synchronization [req-46795621-054c-4cb5-aef8-cf03577efc33 req-47f2ea12-57de-492b-8989-e32c8c723d20 service nova] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 663.910345] env[65511]: INFO networking_nsxv3.common.synchronization [req-46795621-054c-4cb5-aef8-cf03577efc33 req-47f2ea12-57de-492b-8989-e32c8c723d20 service nova] Enqueued Resource ID: f96fe2a9-82cf-4a2c-a721-4344f26f0d83 with Priority: HIGHEST for action port [ 663.910891] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 663.917568] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 663.917675] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f96fe2a9-82cf-4a2c-a721-4344f26f0d83 with Priority: HIGHEST for action port [ 663.918017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.918165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.918263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.918479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.919647] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.920335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.920443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.920495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.920710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.920948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.921801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.921902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.922168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.922233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.922314] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.924034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.924195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.924255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.924393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.924479] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96fe2a9-82cf-4a2c-a721-4344f26f0d83',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.425024] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.426256] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.426397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.427654] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f96fe2a9-82cf-4a2c-a721-4344f26f0d83 with status ACTIVE [ 664.428037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.428769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.428876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.429123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.429220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.429411] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.429550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.429594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.429732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.429809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.429993] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.430100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.430161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.430308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.430382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.430474] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f96fe2a9-82cf-4a2c-a721-4344f26f0d83 is going to be updated. [ 664.517687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.517856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.517933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.518208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.518380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.518652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f96fe2a9-82cf-4a2c-a721-4344f26f0d83" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.929865] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.433590] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.433976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.433976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.434079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.434284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.434436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be created. [ 665.469896] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.469896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.469896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.470137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.470324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.481640] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: UNINITIALIZED for 2s [ 667.278023] env[65511]: INFO networking_nsxv3.common.synchronization [None req-cc311453-b6f4-4720-ba1f-6858d690f235 None None] Enqueued Resource ID: 0c4a6386-35fe-429c-9eb5-0f27f678c4dc with Priority: HIGHEST for action port [ 667.278601] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4a6386-35fe-429c-9eb5-0f27f678c4dc with Priority: HIGHEST for action port [ 667.278922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c4a6386-35fe-429c-9eb5-0f27f678c4dc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.279058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c4a6386-35fe-429c-9eb5-0f27f678c4dc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.279134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c4a6386-35fe-429c-9eb5-0f27f678c4dc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.281496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c4a6386-35fe-429c-9eb5-0f27f678c4dc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.281842] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4a6386-35fe-429c-9eb5-0f27f678c4dc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.494499] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 667.494660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.494851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.495128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.495365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.495521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.495628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.495816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.495937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.496051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.496214] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.694275] env[65511]: INFO networking_nsxv3.common.synchronization [req-1a9cbe84-864d-4b80-b236-17f9871d9e52 req-7e368da2-b6a1-4999-9354-58383ed2bf20 tempest-ListImageFiltersTestJSON-1712442466 tempest-ListImageFiltersTestJSON-1712442466-project-member] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 667.697527] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 667.697527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.697527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.697527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.698085] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.784197] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c4a6386-35fe-429c-9eb5-0f27f678c4dc [ 667.784197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.784197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.784520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.784561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.786522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.786522] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c4a6386-35fe-429c-9eb5-0f27f678c4dc already deleted. [ 667.786522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c4a6386-35fe-429c-9eb5-0f27f678c4dc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.000141] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.201595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.202132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.202310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.202669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.202752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.203146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.203217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.203302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.203538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.203632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.203773] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 already deleted. [ 668.203882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.267190] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.267391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.267501] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.267758] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.268027] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.268155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.268291] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.268500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.268629] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.268817] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.268915] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.269044] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.269117] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.269222] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.269315] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.269537] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.289552] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.290275] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.290275] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.290275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.290392] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-949897ab-d75f-4021-ab95-61352dcf7ef4 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.290545] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.290654] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.291798] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.291798] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949897ab-d75f-4021-ab95-61352dcf7ef4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.503376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502: rpc.has_security_group_logging(os_id): False [ 668.523044] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.523044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.523248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.523323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.523613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.523681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.524213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.524213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.524213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.524213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.524213] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be created. [ 668.587837] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.588024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.588095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.588322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.589172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.601127] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 668.795605] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.795605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.795605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.795605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.795605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.795605] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 949897ab-d75f-4021-ab95-61352dcf7ef4 not found, creating... [ 668.795605] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.796443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.796443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.796443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.796443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.796589] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.796653] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.796961] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.797056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.797169] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.797259] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 949897ab-d75f-4021-ab95-61352dcf7ef4 is going to be created. [ 668.822503] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.822664] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.822782] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.823087] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.823316] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.823539] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.549567] env[65511]: INFO networking_nsxv3.common.synchronization [req-1a9cbe84-864d-4b80-b236-17f9871d9e52 req-3dc31347-a83e-4b77-8f7c-4e9ad27c5034 service nova] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_rules [ 669.550037] env[65511]: INFO networking_nsxv3.common.synchronization [req-1a9cbe84-864d-4b80-b236-17f9871d9e52 req-3dc31347-a83e-4b77-8f7c-4e9ad27c5034 service nova] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 669.550398] env[65511]: INFO networking_nsxv3.common.synchronization [req-1a9cbe84-864d-4b80-b236-17f9871d9e52 req-3dc31347-a83e-4b77-8f7c-4e9ad27c5034 service nova] Enqueued Resource ID: 949897ab-d75f-4021-ab95-61352dcf7ef4 with Priority: HIGHEST for action port [ 669.551117] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_rules [ 669.551486] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 669.552099] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 949897ab-d75f-4021-ab95-61352dcf7ef4 with Priority: HIGHEST for action port [ 669.552584] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.552727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.552794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.553239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.553239] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.554155] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.554155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.554333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.555095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.555095] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.555095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.555095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.558932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.558932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.558932] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.558932] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-949897ab-d75f-4021-ab95-61352dcf7ef4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.558932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.558932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.558932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.558932] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('949897ab-d75f-4021-ab95-61352dcf7ef4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.887699] env[65511]: INFO networking_nsxv3.common.synchronization [req-5a8c07cf-4393-4769-84b5-84926a7e89ab req-5b18dcd9-daa2-4ab9-8e60-851134f2a09b tempest-ServersNegativeTestMultiTenantJSON-1735836737 tempest-ServersNegativeTestMultiTenantJSON-1735836737-project-member] Enqueued Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 669.887699] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 669.890539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.890539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.890539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.890539] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.976560] env[65511]: INFO networking_nsxv3.common.synchronization [None req-560e61f4-d572-4b64-8662-4c3af751a5b6 None None] Enqueued Resource ID: 69ec90fc-a3a5-41e8-8e9e-6a86053c2232 with Priority: HIGHEST for action port [ 669.984651] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ec90fc-a3a5-41e8-8e9e-6a86053c2232 with Priority: HIGHEST for action port [ 669.984651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ec90fc-a3a5-41e8-8e9e-6a86053c2232 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.984651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ec90fc-a3a5-41e8-8e9e-6a86053c2232" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.984651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ec90fc-a3a5-41e8-8e9e-6a86053c2232" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.984651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ec90fc-a3a5-41e8-8e9e-6a86053c2232" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.984651] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ec90fc-a3a5-41e8-8e9e-6a86053c2232',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.065423] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.069350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.069350] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 949897ab-d75f-4021-ab95-61352dcf7ef4 with status ACTIVE [ 670.069350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.069350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.069350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.069350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.070625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.070625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.070625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.070625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.070625] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 949897ab-d75f-4021-ab95-61352dcf7ef4 is going to be updated. [ 670.096931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.097672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.097792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.098060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.098250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.098533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-949897ab-d75f-4021-ab95-61352dcf7ef4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.258012] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-721 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.258197] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.258279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.258591] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.258847] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.258998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.259312] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.259844] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.259996] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.260265] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.260348] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.260481] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.260586] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.260695] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.260792] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.260918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.280208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.280406] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.282342] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.282342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-721" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.282342] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-6d83d486-2d9d-46cc-99af-ca4c2c57a088 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.282342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.282342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.282342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.282342] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d83d486-2d9d-46cc-99af-ca4c2c57a088',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.391845] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.392012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.392092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.392436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.392561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.392798] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.392917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.392993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.396515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.396515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.396515] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 already deleted. [ 670.396515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.488345] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69ec90fc-a3a5-41e8-8e9e-6a86053c2232 [ 670.488577] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.488710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.488779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.488999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.489106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.489200] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69ec90fc-a3a5-41e8-8e9e-6a86053c2232 already deleted. [ 670.489282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ec90fc-a3a5-41e8-8e9e-6a86053c2232" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.573938] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.615860] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 670.615860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.784681] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.784891] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.785015] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.785352] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.785528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.785677] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 6d83d486-2d9d-46cc-99af-ca4c2c57a088 not found, creating... [ 670.785915] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.786074] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.786183] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.786404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.786538] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.786801] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.786946] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.787064] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.787263] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.787387] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.787519] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 6d83d486-2d9d-46cc-99af-ca4c2c57a088 is going to be created. [ 670.809386] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.809594] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.809705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.809998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.810191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.810431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.080592] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.080832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.080941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.081202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.081298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.081398] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be created. [ 671.112981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.113236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.113236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.113453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.113612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.125998] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: UNINITIALIZED for 2s [ 671.280678] env[65511]: INFO networking_nsxv3.common.synchronization [None req-51854b92-aa69-4213-8223-acaaa330b08e None None] Enqueued Resource ID: bf72c1bf-6778-440c-b5f9-6d62193e9627 with Priority: HIGHEST for action port [ 671.280916] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf72c1bf-6778-440c-b5f9-6d62193e9627 with Priority: HIGHEST for action port [ 671.282595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf72c1bf-6778-440c-b5f9-6d62193e9627 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.282595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf72c1bf-6778-440c-b5f9-6d62193e9627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.282595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf72c1bf-6778-440c-b5f9-6d62193e9627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.282595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf72c1bf-6778-440c-b5f9-6d62193e9627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.282595] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf72c1bf-6778-440c-b5f9-6d62193e9627',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [req-5a8c07cf-4393-4769-84b5-84926a7e89ab req-eaba7040-4dbf-48ca-b862-adecb3d84c5e service nova] Enqueued Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_rules [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [req-5a8c07cf-4393-4769-84b5-84926a7e89ab req-eaba7040-4dbf-48ca-b862-adecb3d84c5e service nova] Enqueued Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [req-5a8c07cf-4393-4769-84b5-84926a7e89ab req-eaba7040-4dbf-48ca-b862-adecb3d84c5e service nova] Enqueued Resource ID: 6d83d486-2d9d-46cc-99af-ca4c2c57a088 with Priority: HIGHEST for action port [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_rules [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 671.587673] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d83d486-2d9d-46cc-99af-ca4c2c57a088 with Priority: HIGHEST for action port [ 671.592862] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.598025] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.598025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.598025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.598025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.599443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.599443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.599443] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.602601] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d83d486-2d9d-46cc-99af-ca4c2c57a088 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.602601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.602601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.602601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.602601] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d83d486-2d9d-46cc-99af-ca4c2c57a088',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.785454] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf72c1bf-6778-440c-b5f9-6d62193e9627 [ 671.785638] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.785752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.785752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.786097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.786759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.786759] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf72c1bf-6778-440c-b5f9-6d62193e9627 already deleted. [ 671.786759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf72c1bf-6778-440c-b5f9-6d62193e9627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.103501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.103780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.104099] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.105023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d83d486-2d9d-46cc-99af-ca4c2c57a088 with status ACTIVE [ 672.105299] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.106510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.106510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.106920] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.106920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.106920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.107640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.107640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.107640] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d83d486-2d9d-46cc-99af-ca4c2c57a088 is going to be updated. [ 672.131137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.131381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.131519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.131784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.131983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.132514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d83d486-2d9d-46cc-99af-ca4c2c57a088" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.611237] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.109346] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 673.109503] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 673.110084] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 673.110233] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 673.110515] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.110632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.110698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.110972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.111230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.111338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.111395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.111563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.111650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.111747] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.113029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.113124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.113193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.113357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.113522] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.113600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.113655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.113802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.113888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.113976] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.115996] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.116376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.116452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.116629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.116712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.116804] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 is going to be created. [ 673.145754] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 673.145948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.146663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.147692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.147692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.147692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.147692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.151248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.151248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.151248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.153527] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.160156] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.160378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.160525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.161426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.161426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.178741] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: UNINITIALIZED for 2s [ 673.216255] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_rules [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [req-74f503d1-e1b8-4492-a189-7d90da8e9ab8 req-e7c95d85-0398-4fac-b1ac-4509d52019cc tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_rules [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 673.219555] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 673.219555] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.219555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.219555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.219555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.219555] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.221231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.221231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.221231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.221231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.221231] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.221636] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.221754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.221815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.222013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.223299] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2404acc7-dfde-4d85-9ed0-a713d0f1ce78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.224456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.224456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.224456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.224802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.618889] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.620152] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.657295] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.657295] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.657295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.657888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.657888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.657888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.657888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.657888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.658134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.658134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.658134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.658241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.658287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.658379] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.725507] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.725700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.725949] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.727086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.727086] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with status ACTIVE [ 673.727086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.727086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.727086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.727086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.727086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.727455] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.727455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.727455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.727455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.727766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.730861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.730968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.731251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.731251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.731415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.731415] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 is going to be updated. [ 673.753669] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.753897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.753897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.754164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.754303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.754559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.123758] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.125262] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.160168] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc42862b-f71b-41f8-ad04-30546bed9ee5: rpc.has_security_group_logging(os_id): False [ 674.181659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.181832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.181952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.183056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.183247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.183570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.183761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.183871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.184142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.184388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.184987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.185153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.185260] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.185465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.185680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.185816] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.185944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.185988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.186147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.186244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.186322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be created. [ 674.256378] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.256378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.256623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.256663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.256859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.272035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 674.485201] env[65511]: INFO networking_nsxv3.common.synchronization [req-a8b1e20a-4027-401c-8a43-48f80df3b7c6 req-7ffebbea-ad75-415f-ab96-047582b48214 tempest-DeleteServersAdminTestJSON-1445424325 tempest-DeleteServersAdminTestJSON-1445424325-project-member] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 674.485749] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 674.486865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.486865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.486865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.486865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.486865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.486865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.486865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.487216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.487216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.487216] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.630314] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.630314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.630314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.630314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.630314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.630314] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be created. [ 674.632442] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.632782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.633057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.633391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.633655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.634035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 674.662074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.662421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.663856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.663856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.663856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.665214] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.665400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.665468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.665663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.665882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.676367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: UNINITIALIZED for 2s [ 674.677048] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 674.854857] env[65511]: INFO networking_nsxv3.common.synchronization [req-2ba4a9b9-9228-4396-8590-d3d1b73ebd8c req-3e6c91f5-5c34-4bb2-ac40-b9b490deaffd tempest-ServerPasswordTestJSON-2016159458 tempest-ServerPasswordTestJSON-2016159458-project-member] Enqueued Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 674.858718] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGHEST for action security_group_members [ 674.861910] env[65511]: INFO networking_nsxv3.common.synchronization [None req-043b3109-6c54-48d7-9e1e-1c8313388f21 None None] Enqueued Resource ID: eb99c6b3-6712-40d2-9027-88e955559c15 with Priority: HIGHEST for action port [ 674.861910] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.861910] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.861910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.861910] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.861910] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb99c6b3-6712-40d2-9027-88e955559c15 with Priority: HIGHEST for action port [ 674.862987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb99c6b3-6712-40d2-9027-88e955559c15 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.863061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb99c6b3-6712-40d2-9027-88e955559c15" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.863125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb99c6b3-6712-40d2-9027-88e955559c15" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.863395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb99c6b3-6712-40d2-9027-88e955559c15" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.863475] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb99c6b3-6712-40d2-9027-88e955559c15',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.990439] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.990646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.990693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.990883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.990973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.991234] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.991342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.991396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.991563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.991641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.991729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be updated. [ 675.024171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.024387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.024495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.024730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.025100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.035414] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 675.118636] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.121449] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.121449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.121449] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.121449] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.121449] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.121449] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.121449] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.121449] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.122213] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.143192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.143387] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.143970] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.143970] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.143970] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-f95a92a6-afd6-4309-b5b6-b15508409d57 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.144252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.144310] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.144671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.144811] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95a92a6-afd6-4309-b5b6-b15508409d57',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.190451] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: SUCCESS [ 675.190590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.191106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.191396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.191614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.191741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.191815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.191984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.192269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.192387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.192484] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.366821] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb99c6b3-6712-40d2-9027-88e955559c15 [ 675.366821] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.366821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.367090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.367152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.370446] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb99c6b3-6712-40d2-9027-88e955559c15 already deleted. [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb99c6b3-6712-40d2-9027-88e955559c15" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.370446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.370446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.370446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.370446] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 is going to be updated. [ 675.423911] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.424148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.424148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.424363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.424519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.450332] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: IN_PROGRESS for 2s [ 675.647182] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.647507] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.648018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.648018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.648155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.648216] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port f95a92a6-afd6-4309-b5b6-b15508409d57 not found, creating... [ 675.648486] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.649228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.649228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.649228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.649228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.649430] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.649536] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.649641] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.649839] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.649958] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.650935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: f95a92a6-afd6-4309-b5b6-b15508409d57 is going to be created. [ 675.672408] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.672676] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.672796] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.673071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.673295] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.673501] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.695832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.696073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.696152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.696373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.696560] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.696659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.696722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.696877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.696998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.697073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.697237] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.697337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.697398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.697548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.697686] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.699413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.699413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.699413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.699413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.699413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.699413] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.202178] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b3f50d6-1505-4f60-b90b-731edbc55041: rpc.has_security_group_logging(os_id): False [ 676.220701] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.220701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.220701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.220858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.220997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.221377] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.221527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.221591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.221770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.221850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.222242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.222324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.222554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.222695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222979] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.223145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.223211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.223386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.223469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.223555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 is going to be created. [ 676.291539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.291743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.291743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.291969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.292165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.303203] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: IN_PROGRESS for 2s [ 676.306087] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 676.306402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.358897] env[65511]: INFO networking_nsxv3.common.synchronization [req-4eb47d7d-ac36-4b32-979a-1431e262c9ca req-135e6cd7-dee4-4fb4-b24a-0d02691eeef0 tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 676.359400] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 676.359606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2318731e-002c-4571-ab62-1b638db2e584 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.359735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.359811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.360143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.360234] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2318731e-002c-4571-ab62-1b638db2e584',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.423412] env[65511]: INFO networking_nsxv3.common.synchronization [req-a8b1e20a-4027-401c-8a43-48f80df3b7c6 req-852cde32-d774-4bde-987c-dd9d08fa5ecb service nova] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_rules [ 676.423598] env[65511]: INFO networking_nsxv3.common.synchronization [req-a8b1e20a-4027-401c-8a43-48f80df3b7c6 req-852cde32-d774-4bde-987c-dd9d08fa5ecb service nova] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 676.423699] env[65511]: INFO networking_nsxv3.common.synchronization [req-a8b1e20a-4027-401c-8a43-48f80df3b7c6 req-852cde32-d774-4bde-987c-dd9d08fa5ecb service nova] Enqueued Resource ID: f95a92a6-afd6-4309-b5b6-b15508409d57 with Priority: HIGHEST for action port [ 676.424206] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_rules [ 676.424371] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 676.424476] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f95a92a6-afd6-4309-b5b6-b15508409d57 with Priority: HIGHEST for action port [ 676.424995] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.425422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.425510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.425823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.425823] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.426946] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.426946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.426946] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f95a92a6-afd6-4309-b5b6-b15508409d57 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.427124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.427124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.427271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.427337] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f95a92a6-afd6-4309-b5b6-b15508409d57',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.690170] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 676.690958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.691294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.691718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.692145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.692527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.692977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.693153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.696892] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.696892] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.696892] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.696892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.696892] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.891827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.891980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.892063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.892332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.893106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.893322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2318731e-002c-4571-ab62-1b638db2e584 already deleted. [ 676.893445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.929307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.929307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.929307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f95a92a6-afd6-4309-b5b6-b15508409d57 with status ACTIVE [ 676.929541] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.929541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.929620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.929958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.929958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.930121] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.930121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.930360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.930360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.930476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.930632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.930716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.930716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.930855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.930920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.930982] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f95a92a6-afd6-4309-b5b6-b15508409d57 is going to be updated. [ 676.962623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.962818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.962862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.963068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.963208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.963361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f95a92a6-afd6-4309-b5b6-b15508409d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.048128] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 677.048334] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 deletion is rescheduled due to dependency. [ 677.048544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.048698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.048951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.049160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.049281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.049346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.049531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.049592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.049684] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.200452] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.201671] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.343701] env[65511]: INFO networking_nsxv3.common.synchronization [req-471a475d-9d74-407c-89a3-a9bccdfbd1ef req-bd028451-e94a-4988-9ea7-16110f08a7d4 tempest-ListImageFiltersTestJSON-1712442466 tempest-ListImageFiltersTestJSON-1712442466-project-member] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 677.344357] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 677.344695] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.344821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.344884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.345624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.345828] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.345986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.347277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.347483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.347604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.347718] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.462414] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 in Status: SUCCESS [ 677.462743] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 deletion is rescheduled due to dependency. [ 677.462965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.553962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.703331] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.704550] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.851560] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.057465] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.205873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.206081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.206149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.206365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.206458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.206560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 678.207853] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.207967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.208041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.208239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.208297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.208375] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 678.212578] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5bc72d19-ce62-460a-bae0-eda4d62ec706 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 678.213600] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 678.214307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.214445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.214514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.214815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.214915] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.244023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.244023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.244023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.244023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.244023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.245943] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.249023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.249023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.249023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.249023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.265030] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 678.267041] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 678.321675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: SUCCESS [ 678.321831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.355696] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.540102] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.540552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.540552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.540712] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.544378] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.544378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.544378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.544378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.544378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.544378] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.544378] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.544378] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.544378] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.544378] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.544378] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.544378] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.560041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.560041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.560041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.560322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.560358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.561718] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be updated. [ 678.566750] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.566750] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.567007] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.569617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.569617] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.569617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.569617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.569617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.569617] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e8d77c-daa3-4ea6-8d7f-6df622b6b033',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.595848] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.598031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.598031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.598031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.598031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.609307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 678.736090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.736456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.736456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.736603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.736603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.736690] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f already deleted. [ 678.737070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.799710] env[65511]: INFO networking_nsxv3.common.synchronization [req-9851820a-c69d-4293-815f-394e868aa5ea req-3b2310df-6a58-449b-90b6-c3fef8414d25 tempest-ServerDiagnosticsNegativeTest-2147345831 tempest-ServerDiagnosticsNegativeTest-2147345831-project-member] Enqueued Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 678.801021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGHEST for action security_group_members [ 678.801021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.801021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.801021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.801365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.801365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.801365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.801365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.801625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.801625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.801696] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.805143] env[65511]: INFO networking_nsxv3.common.synchronization [None req-10badd52-d73a-43e8-9d4a-58a813de96fe None None] Enqueued Resource ID: 7849f7e3-a36e-441e-9758-dd4b40940b88 with Priority: HIGHEST for action port [ 678.805755] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7849f7e3-a36e-441e-9758-dd4b40940b88 with Priority: HIGHEST for action port [ 678.805889] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7849f7e3-a36e-441e-9758-dd4b40940b88 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.805997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7849f7e3-a36e-441e-9758-dd4b40940b88" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.806080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7849f7e3-a36e-441e-9758-dd4b40940b88" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.806322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7849f7e3-a36e-441e-9758-dd4b40940b88" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.806407] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7849f7e3-a36e-441e-9758-dd4b40940b88',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.857896] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.858224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.858224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.858385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.858474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.858573] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be updated. [ 678.887858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.888090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.888090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.888286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.888433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.898127] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 679.072024] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.072275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.072398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.072672] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.072814] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.072959] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 not found, creating... [ 679.073245] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.073395] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.073502] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.073746] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.073878] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.074167] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.074336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.074451] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.074652] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.074778] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.074911] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 is going to be created. [ 679.096236] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.096458] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.096574] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.096833] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.097065] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.098857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.304425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.304615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.304689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.304951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.305079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.305303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.305432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.305506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.305716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.305797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.305908] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a is going to be updated. [ 679.308705] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7849f7e3-a36e-441e-9758-dd4b40940b88 [ 679.308894] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.309018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.309164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.309285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.309445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.309545] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7849f7e3-a36e-441e-9758-dd4b40940b88 already deleted. [ 679.309681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7849f7e3-a36e-441e-9758-dd4b40940b88" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.367398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.367567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.367619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.368517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.368517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.381038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: IN_PROGRESS for 2s [ 679.826947] env[65511]: INFO networking_nsxv3.common.synchronization [None req-561121f2-09c8-497a-a45b-c5c7363f5e58 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 679.826947] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 679.827335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.827335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.827434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.827589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.827667] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.996102] env[65511]: INFO networking_nsxv3.common.synchronization [req-471a475d-9d74-407c-89a3-a9bccdfbd1ef req-293b4977-fdc6-4a2a-8929-e6d378020541 service nova] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_rules [ 679.996290] env[65511]: INFO networking_nsxv3.common.synchronization [req-471a475d-9d74-407c-89a3-a9bccdfbd1ef req-293b4977-fdc6-4a2a-8929-e6d378020541 service nova] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 679.996400] env[65511]: INFO networking_nsxv3.common.synchronization [req-471a475d-9d74-407c-89a3-a9bccdfbd1ef req-293b4977-fdc6-4a2a-8929-e6d378020541 service nova] Enqueued Resource ID: 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 with Priority: HIGHEST for action port [ 679.997130] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_rules [ 679.997267] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 679.997350] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 with Priority: HIGHEST for action port [ 679.997628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.997747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.997844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.998010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.998097] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.999031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.999256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.999346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.999467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.999467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.999639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.999721] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e8d77c-daa3-4ea6-8d7f-6df622b6b033',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.287423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 680.287490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.288615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.288615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.288615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.288752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.288792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.288959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.289070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.289159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.289245] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.290890] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 680.291082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.291962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.293586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.293586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.293586] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.358825] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.359185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.359341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.359703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.359862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.363441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f already deleted. [ 680.363665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.502024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.502024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.502024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 with status ACTIVE [ 680.502024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.502286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.502286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.502405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.502540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.502735] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.502855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.502929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.503278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.503278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.503492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.503614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.503689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.503989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.503989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.504111] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94e8d77c-daa3-4ea6-8d7f-6df622b6b033 is going to be updated. [ 680.526102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.526213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.526308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.526494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.526945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.526945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e8d77c-daa3-4ea6-8d7f-6df622b6b033" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.624169] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.624169] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.624169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.624169] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.795698] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.797207] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.797393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.797508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.797767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.797934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.798407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.798549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.798764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.798885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.798995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.799257] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.799311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.799345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.799505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.799643] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.799734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.799788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.799952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.800045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.800126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.800213] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.803209] env[65511]: INFO networking_nsxv3.common.synchronization [req-00b47131-dda3-4a05-b2b0-1a4f278c017e req-910b81cd-41fc-48b9-8036-7645ace50114 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 680.803961] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 680.805090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.805090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.805090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.805951] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.849025] env[65511]: INFO networking_nsxv3.common.synchronization [None req-46fe3d51-7df8-4b59-b2fa-b5ff59067e47 None None] Enqueued Resource ID: ae023bc9-910b-449b-9ddb-eaf6d0128eb2 with Priority: HIGHEST for action port [ 680.851359] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae023bc9-910b-449b-9ddb-eaf6d0128eb2 with Priority: HIGHEST for action port [ 680.851611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae023bc9-910b-449b-9ddb-eaf6d0128eb2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.851737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae023bc9-910b-449b-9ddb-eaf6d0128eb2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.851899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae023bc9-910b-449b-9ddb-eaf6d0128eb2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.852075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae023bc9-910b-449b-9ddb-eaf6d0128eb2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.852165] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae023bc9-910b-449b-9ddb-eaf6d0128eb2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.910390] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 680.910561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.910739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.910973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.911179] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.911298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.911360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.911511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.911592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.911687] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.126509] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.126800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.126862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.127285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.127488] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.127599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.127665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.127853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.127943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.128047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.128206] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.128474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.128561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.128726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.128872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.129015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.129093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.129243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.129680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.129803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.129899] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.192565] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.192766] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.192847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.194052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.194052] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.194052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.194052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.194052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.194979] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.195246] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.195371] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.195612] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.195612] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.197927] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.197927] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.197927] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.218404] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.218492] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.219217] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.219217] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.219217] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.221500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.221500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.221500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.221500] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063853b8-0897-4c1a-ab5a-edc96a4cb6d2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.305566] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0211564f-7b41-42e2-85dc-08114fde7981: rpc.has_security_group_logging(os_id): False [ 681.305566] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 681.309548] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.309548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.309548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.309548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.309548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.309548] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.309548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.309947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.309947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.309947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.310083] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e already deleted. [ 681.310117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.332966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.333234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.333337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.333600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.333753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.334053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.334194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.334363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.334611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.334781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.334980] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.335148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.335223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.335458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.335586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.335705] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.335838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.335889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.336048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.336162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.336214] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 681.338352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.338561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.338561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.338740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.338828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.339092] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.339189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.339233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.339382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.339446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.339536] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be created. [ 681.354757] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae023bc9-910b-449b-9ddb-eaf6d0128eb2 [ 681.355100] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.355266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.355416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.355695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.355810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.355858] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae023bc9-910b-449b-9ddb-eaf6d0128eb2 already deleted. [ 681.355995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae023bc9-910b-449b-9ddb-eaf6d0128eb2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.398235] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a in Status: SUCCESS [ 681.398459] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a deletion is rescheduled due to dependency. [ 681.398615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.414215] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.427509] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.427728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.427728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.427987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.428201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.434827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.435102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.435102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.435249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.435465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.443161] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 681.449550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 681.632617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6768aa0-c3a8-4794-8747-efcb8cb86558: rpc.has_security_group_logging(os_id): False [ 681.653560] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.653715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.653777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.653964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.654100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.654297] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.654425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.654488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.654661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.654740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.654929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.655037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.655096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.655242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.655317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.655691] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.655888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.656019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.657209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.657209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.657209] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be updated. [ 681.723144] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.723353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.723457] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.723730] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.723870] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.724029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 not found, creating... [ 681.724619] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.724824] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.724966] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.725261] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.725528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.726141] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.726141] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.726141] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.726677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.726677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.726677] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 is going to be created. [ 681.729200] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.729851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.729851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.729851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.751888] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 681.758794] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.758794] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.758794] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.758794] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.758794] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.758794] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.909960] env[65511]: INFO networking_nsxv3.common.synchronization [req-b3766b5a-8293-459e-84fa-4d20ffcb13b7 req-9775eec7-c49d-4973-a3db-e86d5d2284e2 tempest-FloatingIPsAssociationTestJSON-861519946 tempest-FloatingIPsAssociationTestJSON-861519946-project-member] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 681.909960] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 681.910330] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.910560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.910560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.910679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.910833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.910927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.910998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.911369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.911369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.911369] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.917330] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.414656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.418715] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.418915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.418989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.419223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.419317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.419417] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be updated. [ 682.445178] env[65511]: INFO networking_nsxv3.common.synchronization [req-00b47131-dda3-4a05-b2b0-1a4f278c017e req-390f2e62-2b29-43a6-b55e-872a85631641 service nova] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 682.445178] env[65511]: INFO networking_nsxv3.common.synchronization [req-00b47131-dda3-4a05-b2b0-1a4f278c017e req-390f2e62-2b29-43a6-b55e-872a85631641 service nova] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 682.445431] env[65511]: INFO networking_nsxv3.common.synchronization [req-00b47131-dda3-4a05-b2b0-1a4f278c017e req-390f2e62-2b29-43a6-b55e-872a85631641 service nova] Enqueued Resource ID: 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 with Priority: HIGHEST for action port [ 682.446057] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_rules [ 682.451116] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 682.451825] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 with Priority: HIGHEST for action port [ 682.452598] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.452738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.452807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.453039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.455496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.455496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.455496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.455496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.455929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.455929] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.456667] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.456778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.456845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.457062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.457187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.457275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.457614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.457614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.457614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.458116] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.459327] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.459447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.459496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.459659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.459735] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063853b8-0897-4c1a-ab5a-edc96a4cb6d2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.472968] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 682.652401] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-570 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.652586] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.652700] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.652958] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.653329] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.653431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.653487] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.653656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.653788] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.654015] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.654135] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.654238] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.654362] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.654473] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.654570] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.654693] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.670541] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 682.670703] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 682.670866] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 682.671345] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 682.671547] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 682.671547] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 682.672558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.672682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.672773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.673090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.673281] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.673419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.673488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.673692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.673815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.673931] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.675357] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.675627] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.675701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.675866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.676018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.676114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.676174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.676316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.676402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.676485] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.678376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.679156] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.679156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.679551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.679551] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.680807] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.680948] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.681095] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.681254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-570" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.681574] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-7600c40c-49be-4a61-9982-06d0ae2f1335 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.681761] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.681898] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.682225] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.682363] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7600c40c-49be-4a61-9982-06d0ae2f1335',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.716202] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_rules [ 682.716360] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 682.716498] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_rules [ 682.716665] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 682.716757] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 682.716876] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 682.716990] env[65511]: INFO networking_nsxv3.common.synchronization [req-639e72ab-005e-4ea6-b318-5bd32c5e6e07 req-604a30ae-298d-4a00-b79d-06ecd6f0cfe3 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 682.717444] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_rules [ 682.717576] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_rules [ 682.717669] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 682.717757] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with Priority: HIGHEST for action port [ 682.717842] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 682.717926] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 682.718015] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 682.718288] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.718388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.718573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.718675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.718737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.718987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.719082] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.719938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.720867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.720867] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.720867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.720867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.720867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.720867] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2404acc7-dfde-4d85-9ed0-a713d0f1ce78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.721449] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.721532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.721713] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.721791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.722383] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.722383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.917870] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.966085] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.966085] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.966085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.966085] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 with status ACTIVE [ 682.966085] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.966085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.966085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.966618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.966832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.967060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.967865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.967865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.967865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.967865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.967865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.967865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.968498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.968498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.968498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.968498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 063853b8-0897-4c1a-ab5a-edc96a4cb6d2 is going to be updated. [ 682.995319] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.995515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.995515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.995727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.996032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.996166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063853b8-0897-4c1a-ab5a-edc96a4cb6d2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.177060] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.178681] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.185018] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.185207] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.185466] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.185839] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.186044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.186256] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 7600c40c-49be-4a61-9982-06d0ae2f1335 not found, creating... [ 683.186651] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.186868] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.187296] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.187726] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.188040] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.188939] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.189281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.189448] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.189789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.190140] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.190374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 7600c40c-49be-4a61-9982-06d0ae2f1335 is going to be created. [ 683.191817] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.226725] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 with status ACTIVE [ 683.226725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.226725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.226725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.226725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.228196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.228387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2404acc7-dfde-4d85-9ed0-a713d0f1ce78 is going to be updated. [ 683.231442] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.231442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.231993] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.232424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.232560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.232833] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.233226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.233493] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.285642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.285642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.285642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.285642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.285642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.285642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2404acc7-dfde-4d85-9ed0-a713d0f1ce78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.421023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.421297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.421377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.421642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.421752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.421857] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be updated. [ 683.458427] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 683.458666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.459177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.459177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.459756] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.466838] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 683.467184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.467435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.467700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.467792] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.470207] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.470443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.470443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.470617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.470731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.471828] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.485036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 683.682111] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.683225] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.696014] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.890970] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 683.890970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.948372] env[65511]: INFO networking_nsxv3.common.synchronization [req-b3766b5a-8293-459e-84fa-4d20ffcb13b7 req-88154096-e7bd-4fd1-84a8-b72b926d0de0 service nova] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_rules [ 683.948663] env[65511]: INFO networking_nsxv3.common.synchronization [req-b3766b5a-8293-459e-84fa-4d20ffcb13b7 req-88154096-e7bd-4fd1-84a8-b72b926d0de0 service nova] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 683.948872] env[65511]: INFO networking_nsxv3.common.synchronization [req-b3766b5a-8293-459e-84fa-4d20ffcb13b7 req-88154096-e7bd-4fd1-84a8-b72b926d0de0 service nova] Enqueued Resource ID: 7600c40c-49be-4a61-9982-06d0ae2f1335 with Priority: HIGHEST for action port [ 683.949330] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_rules [ 683.949503] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 683.949620] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7600c40c-49be-4a61-9982-06d0ae2f1335 with Priority: HIGHEST for action port [ 683.949918] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.950728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.950728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.950728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.950924] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.951842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.951932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.952516] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7600c40c-49be-4a61-9982-06d0ae2f1335 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.952516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.952516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.952516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.952516] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7600c40c-49be-4a61-9982-06d0ae2f1335',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.962514] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.962718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.971861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.972035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.974535] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.974664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.974743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.975053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.975053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.975170] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e is going to be created. [ 684.005351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.005509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.005579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.005825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.005989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.022664] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: UNINITIALIZED for 2s [ 684.187941] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.188050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.188094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.188361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.188511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.188641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be created. [ 684.190255] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.190427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.191467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.191467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.191467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.191467] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 684.200746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.200912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.201069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.201259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.201396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.201448] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 684.224786] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.226439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.226439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.226649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.226689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.242392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: UNINITIALIZED for 2s [ 684.253972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.253972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.253972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.254380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.259173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.259173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.259173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.259173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.259173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.282374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 684.282374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 684.451525] env[65511]: INFO networking_nsxv3.common.synchronization [req-99d8e18b-361b-4516-982c-df7dd38bf25c req-4e518231-7fa1-4fb5-9b72-3aea91500211 tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 684.451525] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 684.451525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2318731e-002c-4571-ab62-1b638db2e584 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.451844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.451844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.451912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.451949] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2318731e-002c-4571-ab62-1b638db2e584',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.454762] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.454762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.454762] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7600c40c-49be-4a61-9982-06d0ae2f1335 with status ACTIVE [ 684.454762] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.456230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.456338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.456533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.456655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.456875] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.456980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.457299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.457477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.457574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.457780] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.457880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.457967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.458098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.458174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.458262] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7600c40c-49be-4a61-9982-06d0ae2f1335 is going to be updated. [ 684.487187] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 684.487871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.489928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.489928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.489928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.489928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.490216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.490216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.490288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.490444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.490444] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.495351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.495555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.495611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.495816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.495951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.496128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7600c40c-49be-4a61-9982-06d0ae2f1335" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.506469] env[65511]: INFO networking_nsxv3.common.synchronization [req-4d375059-6cf1-424a-a679-f45d7178cbe9 req-39cafc5f-11fa-4261-a9f1-2a5dc044a7b2 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 684.507820] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 684.507948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.508171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.508328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.508627] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.509191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.509191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.509191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.509399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.509582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.509631] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.978576] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.978883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.978883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.979034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.979152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.979333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2318731e-002c-4571-ab62-1b638db2e584 already deleted. [ 684.979333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.995468] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.995664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.995714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.995941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.996154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.996317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.996381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.996502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.996586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.996890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.996991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.997067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.997215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.997367] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.997459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.997522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.997663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.997743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.997822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.997913] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.011543] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.123442] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.123442] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.123442] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.123774] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.123851] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.123992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.124146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.124721] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.124721] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.124967] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.124967] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.124967] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.125099] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.125192] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.125271] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.125586] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.147306] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.147306] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.147478] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.147576] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.147920] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-1a039236-a550-4405-80b4-ff094123ab9b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.148096] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.148216] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.148528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.148668] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a039236-a550-4405-80b4-ff094123ab9b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.499197] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 685.499901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.500977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.500977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.501653] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.502428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.502428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.502428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.503159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.503159] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.504232] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc42862b-f71b-41f8-ad04-30546bed9ee5: rpc.has_security_group_logging(os_id): False [ 685.513574] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.526456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.526687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.526744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.526970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.527096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.527331] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.527437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.527507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.527682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.527761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.527961] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.528074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.528150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.528344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.528410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.528597] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.528698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.528760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.528925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.529010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.529117] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be updated. [ 685.601380] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.601710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.601710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.601902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.602092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.623422] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 685.652039] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.652288] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.652355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.652710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.653165] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.653165] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 1a039236-a550-4405-80b4-ff094123ab9b not found, creating... [ 685.653340] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.653504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.653615] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.653855] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.653992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.654316] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.654725] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.654846] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.655103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.655243] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.655390] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 1a039236-a550-4405-80b4-ff094123ab9b is going to be created. [ 685.684052] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.684376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.684519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.685214] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.685504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.685756] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.007899] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.018894] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.018894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.018894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.018894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.018894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.018894] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 686.033573] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: SUCCESS [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.033573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.033573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.033573] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.052123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.052123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.052123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.052123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.052123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.064830] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 686.255349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: SUCCESS [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.255349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.255349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.255349] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.298029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 686.298029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.298029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.298029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.298993] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.299413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.299618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.302287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.302287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.302287] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.302287] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 686.305463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.305951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.307286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.307737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.308940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.309213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.309617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.311019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.311019] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.417090] env[65511]: INFO networking_nsxv3.common.synchronization [req-4d375059-6cf1-424a-a679-f45d7178cbe9 req-264452c1-22f2-49c8-b490-3f15be8c059e service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 686.417090] env[65511]: INFO networking_nsxv3.common.synchronization [req-4d375059-6cf1-424a-a679-f45d7178cbe9 req-264452c1-22f2-49c8-b490-3f15be8c059e service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 686.417090] env[65511]: INFO networking_nsxv3.common.synchronization [req-4d375059-6cf1-424a-a679-f45d7178cbe9 req-264452c1-22f2-49c8-b490-3f15be8c059e service nova] Enqueued Resource ID: 1a039236-a550-4405-80b4-ff094123ab9b with Priority: HIGHEST for action port [ 686.418576] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 686.419143] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 686.419467] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a039236-a550-4405-80b4-ff094123ab9b with Priority: HIGHEST for action port [ 686.420119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.422265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.422265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.422265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.422265] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.423256] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.423573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.424055] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a039236-a550-4405-80b4-ff094123ab9b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.424419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.424810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.425915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.425915] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a039236-a550-4405-80b4-ff094123ab9b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.510068] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.535591] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.757553] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.813957] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.815071] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.929614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.929745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.929829] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a039236-a550-4405-80b4-ff094123ab9b with status ACTIVE [ 686.930079] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.930227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.930315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.930757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.930867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.931087] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.931305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.931653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.931653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.931775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.931971] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.932080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.932143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.932408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.932408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.932592] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a039236-a550-4405-80b4-ff094123ab9b is going to be updated. [ 686.958364] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.958364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.958364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.958364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.958364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.958364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a039236-a550-4405-80b4-ff094123ab9b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.017201] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.017593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.017593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.017771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.017891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.018022] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be updated. [ 687.038187] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48fd9074-e82c-4b2f-86bc-96c1badeaa2e: rpc.has_security_group_logging(os_id): False [ 687.056927] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.057140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.057188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.057613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.057613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.059810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.059928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.060038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.060186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.060276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.060496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.060591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.060652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.060863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.060950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.061048] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e is going to be created. [ 687.092355] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 687.152821] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.152821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.153046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.153241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.153434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.168337] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: IN_PROGRESS for 2s [ 687.260318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.317408] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.317671] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.637321] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 687.637621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.763135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.763346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.763346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.763654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.763763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.764267] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be updated. [ 687.820529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.820711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.820989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.822160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.822970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.823156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 687.824848] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.824848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.824848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.825616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.827589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.827726] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 687.830146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.830988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.830988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.830988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.830988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.847349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: IN_PROGRESS for 2s [ 687.885964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.886223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.886431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.886574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.888401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.888560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.888636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.888812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.888938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.910052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 687.910052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 688.078839] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 688.079211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.079361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.079613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.079948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.080170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.080170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.082464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.082464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.082464] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.591027] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.879991] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8b6c360a-12ea-4f15-ad7b-40c052543217 None None] Enqueued Resource ID: 2f87670c-9945-4336-a26b-a0920d7f9543 with Priority: HIGHEST for action port [ 688.880511] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f87670c-9945-4336-a26b-a0920d7f9543 with Priority: HIGHEST for action port [ 688.881940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f87670c-9945-4336-a26b-a0920d7f9543 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.881940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f87670c-9945-4336-a26b-a0920d7f9543" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.881940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f87670c-9945-4336-a26b-a0920d7f9543" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.881940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f87670c-9945-4336-a26b-a0920d7f9543" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.882151] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f87670c-9945-4336-a26b-a0920d7f9543',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.092923] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.105694] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 689.106149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.106406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.106733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.106807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.106929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.106994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.107161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.107242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.107328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.107418] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.130548] env[65511]: INFO networking_nsxv3.common.synchronization [req-92932044-6920-45ed-98d7-59159747bfe1 req-3315403b-26b0-4d65-98f3-20c3d038fb86 tempest-ServersAdminNegativeTestJSON-511239178 tempest-ServersAdminNegativeTestJSON-511239178-project-member] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 689.131366] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 689.131714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.131839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.131903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.132212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.132448] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.132572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.132638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.132807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.132895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.132989] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.183425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: SUCCESS [ 689.184085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.385060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f87670c-9945-4336-a26b-a0920d7f9543 [ 689.385060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.385060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.385276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.385333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.385430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.385557] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f87670c-9945-4336-a26b-a0920d7f9543 already deleted. [ 689.385621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f87670c-9945-4336-a26b-a0920d7f9543" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.539021] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f3b43c65-d1a0-40e1-a90d-fcd62da0f4ee None None] Enqueued Resource ID: dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae with Priority: HIGHEST for action port [ 689.539021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae with Priority: HIGHEST for action port [ 689.542764] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.542764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.542764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.542764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542764] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.596867] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.597073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.597167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.597475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.597569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.597689] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 689.610330] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.610488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.610550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.611213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.611397] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.612013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.612105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.612345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.612394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.612496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.612665] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.612778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.612845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.613020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.613183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.613274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.613333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.613521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.613612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.613696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.613783] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.634019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.634019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.634019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.634019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.634019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.635097] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.635286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.635393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.635644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.635765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.636020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.636152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.636238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.636424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.636530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.636616] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 already deleted. [ 689.636719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.644093] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 689.858236] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: SUCCESS [ 689.858459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.858459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.860167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.860167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.860167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.923053] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 689.923293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.926183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.926183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.926183] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.927086] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 689.927389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.928392] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.928807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.928807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.928962] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.929943] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.929943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.929943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.929943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.929943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.930315] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.930315] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.930315] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.930675] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.930675] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.930675] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.930675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.932542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.932716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.932966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.933088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.933153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.933393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.933498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.933586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.933676] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.957901] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.958115] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.958208] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.958370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.958684] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-36a79882-5654-46ca-b1cc-70e5d6eecd7a taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.959071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.959071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.961753] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.961753] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a79882-5654-46ca-b1cc-70e5d6eecd7a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.046436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae [ 690.046640] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.046801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.046878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.047111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.047203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.047299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae already deleted. [ 690.047381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe8a154-869b-41a9-9f0f-b6c5e2c1f5ae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.117303] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 264b2244-7780-4186-84f6-37be29843260: rpc.has_security_group_logging(os_id): False [ 690.138202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.138615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.138615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.138721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.138768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.138975] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.139086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.139137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.139299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.139390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.139596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.139696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.139770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.139957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.139957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.140210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.140302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.140373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.140495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.140581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.140641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be updated. [ 690.210412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.210937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.211094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.211581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.211581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.227836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 690.363318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.435983] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.437131] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.437131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.437131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.437380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.437380] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.437516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.437516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.438044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.438044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438044] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.438331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.438331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.438331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.438434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.438507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.438564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.438699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.438789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438949] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.462788] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.463031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.463242] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.463643] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.463892] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.464131] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 36a79882-5654-46ca-b1cc-70e5d6eecd7a not found, creating... [ 690.464559] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.464739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.465056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.465319] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.465553] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.465922] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.466162] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.466324] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.466613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.466796] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.466986] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 36a79882-5654-46ca-b1cc-70e5d6eecd7a is going to be created. [ 690.488671] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.488950] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.489106] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.489433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.489707] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.489976] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.867521] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2226f194-d814-4c64-80d7-5b7c97e1019e: rpc.has_security_group_logging(os_id): False [ 690.888400] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.888558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.888673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.888953] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.889088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.889359] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.889482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.889547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.889733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.889822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.889933] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be created. [ 690.940934] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0211564f-7b41-42e2-85dc-08114fde7981: rpc.has_security_group_logging(os_id): False [ 690.943816] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 690.952135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.952340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.952450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.952739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.952925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.961057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.961214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.961287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.961513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.961624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.961850] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.961957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.962036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.962656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.962656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.962656] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 690.966108] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.966242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.966296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.966961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.966961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.966961] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.966961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.966961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967368] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.967531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.967615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.967712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.967790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.968524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.968639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.968792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.968875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.968974] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 690.973613] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: IN_PROGRESS for 2s [ 691.157062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.157524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.157524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.157524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.157653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.160015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.160015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.160015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.160015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.160403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.210541] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 691.211803] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 691.254119] env[65511]: INFO networking_nsxv3.common.synchronization [req-92932044-6920-45ed-98d7-59159747bfe1 req-9d533c45-49f0-4997-83f7-5b3c0adef89c service nova] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_rules [ 691.254119] env[65511]: INFO networking_nsxv3.common.synchronization [req-92932044-6920-45ed-98d7-59159747bfe1 req-9d533c45-49f0-4997-83f7-5b3c0adef89c service nova] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 691.254119] env[65511]: INFO networking_nsxv3.common.synchronization [req-92932044-6920-45ed-98d7-59159747bfe1 req-9d533c45-49f0-4997-83f7-5b3c0adef89c service nova] Enqueued Resource ID: 36a79882-5654-46ca-b1cc-70e5d6eecd7a with Priority: HIGHEST for action port [ 691.255131] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_rules [ 691.255214] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 691.255322] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36a79882-5654-46ca-b1cc-70e5d6eecd7a with Priority: HIGHEST for action port [ 691.255976] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.255976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.255976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.256261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.256599] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.257724] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.257724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.257724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.258240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.258240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.258240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.258383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.258438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.258545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.258658] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.260440] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-36a79882-5654-46ca-b1cc-70e5d6eecd7a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.260440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.260440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.260440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.260741] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36a79882-5654-46ca-b1cc-70e5d6eecd7a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.659313] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 691.659920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.659920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.660166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.660589] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.660589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.661386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.661386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.661386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.661386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.661386] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.685447] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1704d1cc-aba5-429b-b294-2d7143cea770 None None] Enqueued Resource ID: 1995066a-b098-4674-86ba-dc829bee527f with Priority: HIGHEST for action port [ 691.685447] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1995066a-b098-4674-86ba-dc829bee527f with Priority: HIGHEST for action port [ 691.685447] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1995066a-b098-4674-86ba-dc829bee527f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.685447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1995066a-b098-4674-86ba-dc829bee527f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.685447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1995066a-b098-4674-86ba-dc829bee527f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.686249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1995066a-b098-4674-86ba-dc829bee527f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.686375] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1995066a-b098-4674-86ba-dc829bee527f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.763445] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.764730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.764730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.764941] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36a79882-5654-46ca-b1cc-70e5d6eecd7a with status ACTIVE [ 691.765835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.765835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.765835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.765835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.765835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.765835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.767389] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.767389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.767389] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36a79882-5654-46ca-b1cc-70e5d6eecd7a is going to be updated. [ 691.800145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.801631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.801848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.802338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.802521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.804063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36a79882-5654-46ca-b1cc-70e5d6eecd7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.116571] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0015ac67-cdd6-4416-ae80-1ae22c335334 None None] Enqueued Resource ID: 53c556f2-f828-4f7c-8139-90134da66cdc with Priority: HIGHEST for action port [ 692.117036] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53c556f2-f828-4f7c-8139-90134da66cdc with Priority: HIGHEST for action port [ 692.117305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-53c556f2-f828-4f7c-8139-90134da66cdc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.117419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53c556f2-f828-4f7c-8139-90134da66cdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.117481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53c556f2-f828-4f7c-8139-90134da66cdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.117723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53c556f2-f828-4f7c-8139-90134da66cdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.117845] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c556f2-f828-4f7c-8139-90134da66cdc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.164561] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.164898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.164898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.165763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.165763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.166470] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.166470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.166470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.166470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.166470] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.166470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.166470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.166789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.166789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.166789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.166958] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.193129] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1995066a-b098-4674-86ba-dc829bee527f [ 692.193371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.193667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.193667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.193770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.197020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.197020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1995066a-b098-4674-86ba-dc829bee527f already deleted. [ 692.197020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1995066a-b098-4674-86ba-dc829bee527f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.259417] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 692.260030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.267088] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.623347] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53c556f2-f828-4f7c-8139-90134da66cdc [ 692.623649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.623824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.623916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.624081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.624176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.624273] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53c556f2-f828-4f7c-8139-90134da66cdc already deleted. [ 692.624387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53c556f2-f828-4f7c-8139-90134da66cdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.672016] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95d278ea-5c85-431d-b2c5-e2b81a141e5f: rpc.has_security_group_logging(os_id): False [ 692.693037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.693191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.693458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.693567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.693618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.693811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.693901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.693962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.694130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.694200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.694400] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.694528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.694586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.694735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.694863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.694984] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.700154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.700309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.700741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.700846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.700996] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 692.767382] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.767575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.767642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.768532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.768532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.770523] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.770684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.770750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.771200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.771200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.771200] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be created. [ 692.799101] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 692.805338] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.805809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.805923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.806441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.806617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.819473] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: UNINITIALIZED for 2s [ 692.986243] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: SUCCESS [ 692.986482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.227653] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 693.227995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.229032] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 693.229142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.810908] env[65511]: INFO networking_nsxv3.common.synchronization [None req-192e7298-8f88-4cdc-af39-3deeb95a520d tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 693.811600] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 693.811819] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.812171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.812226] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.008425] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c18035d7-c38e-4b31-a1d4-cef089541562 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 694.008798] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 694.009765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.009915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.334736] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.335576] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c already deleted. [ 694.335576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.335758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.336140] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.817699] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 694.817977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.833237] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 694.834213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.834213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.834213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.834517] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.834517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.834517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.834748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.834875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.834940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.835085] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.857877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.857877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.857877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.858144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.858144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.858859] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c already deleted. [ 694.858859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.339188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.339188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.339188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.339188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.339188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.340220] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.340270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.340311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.342301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.342301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.342731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.343467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.343794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.343910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.344123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.344490] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.760052] env[65511]: INFO networking_nsxv3.common.synchronization [req-55a2d172-30a6-45d7-aade-750898f95917 req-c7460013-95cc-45f3-8927-2d7f94222f31 tempest-InstanceActionsNegativeTestJSON-21442914 tempest-InstanceActionsNegativeTestJSON-21442914-project-member] Enqueued Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 695.760373] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9441a081-4c23-4898-9876-4df61d261ed0 with Priority: HIGHEST for action security_group_members [ 695.760931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9441a081-4c23-4898-9876-4df61d261ed0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.761291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.762035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.762035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.762035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.762268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.762268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.762547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.762620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.762698] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9441a081-4c23-4898-9876-4df61d261ed0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.850632] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0: rpc.has_security_group_logging(os_id): False [ 695.867292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.868533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.868759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.869393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.869868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.870255] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.872319] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.872319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.873298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.873428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.873679] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.873784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.873853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.874033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.874121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.874307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be created. [ 695.936530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.936684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.936753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.936938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.937141] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.951802] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 696.269873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.269873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.269873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.270423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.270423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.270423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.270593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.270593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.270695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.270748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.270839] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9441a081-4c23-4898-9876-4df61d261ed0 is going to be updated. [ 696.304479] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.304735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.304861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.305161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.305381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.315760] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: IN_PROGRESS for 2s [ 696.996455] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5609e49e-741c-4abb-a66f-024895d1df67 None None] Enqueued Resource ID: c784208a-2c4c-46c2-bc8d-30f4e976fb2d with Priority: HIGHEST for action port [ 696.997855] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c784208a-2c4c-46c2-bc8d-30f4e976fb2d with Priority: HIGHEST for action port [ 696.997855] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c784208a-2c4c-46c2-bc8d-30f4e976fb2d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.997855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c784208a-2c4c-46c2-bc8d-30f4e976fb2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.997855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c784208a-2c4c-46c2-bc8d-30f4e976fb2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.998100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c784208a-2c4c-46c2-bc8d-30f4e976fb2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.998191] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c784208a-2c4c-46c2-bc8d-30f4e976fb2d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.501652] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c784208a-2c4c-46c2-bc8d-30f4e976fb2d [ 697.501931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.502134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.502213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.502460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.502572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.502690] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c784208a-2c4c-46c2-bc8d-30f4e976fb2d already deleted. [ 697.502782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c784208a-2c4c-46c2-bc8d-30f4e976fb2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.710660] env[65511]: INFO networking_nsxv3.common.synchronization [req-7157bfbc-9572-40c6-b5b6-595aeeb665c4 req-8dfa1a03-1f4f-4b59-929b-1cc176245d1f tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 697.711606] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 697.712041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.712385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.712385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.712750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.712843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.712937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.712997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.713227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.713309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.713474] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.873673] env[65511]: INFO networking_nsxv3.common.synchronization [req-c4361c1e-d872-4bd4-8f6a-0289252b4f8d req-6bb4fd3f-20ae-4c99-8792-e43b1880f9a5 tempest-SecurityGroupRulesTestJSON-714966839 tempest-SecurityGroupRulesTestJSON-714966839-project-member] Enqueued Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 697.875423] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2318731e-002c-4571-ab62-1b638db2e584 with Priority: HIGHEST for action security_group_rules [ 697.875423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2318731e-002c-4571-ab62-1b638db2e584 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.875423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.875423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.875423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.875423] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2318731e-002c-4571-ab62-1b638db2e584',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.964983] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 697.964983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.216353] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.216353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.216864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.216864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.216864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.216978] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.217043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.217207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.217280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.217320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.217406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 already deleted. [ 698.217486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.242217] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.242415] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.242543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.242853] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.243107] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.243387] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.243387] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.243810] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.243810] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.244076] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.244076] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.244076] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.244217] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.244290] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.244439] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.244514] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.273010] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.273274] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.273421] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.273628] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.273923] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-9e2618bf-9381-4ce3-80e3-a992bd316ac5 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.274117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.274238] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.274582] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.274724] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2618bf-9381-4ce3-80e3-a992bd316ac5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.332060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9441a081-4c23-4898-9876-4df61d261ed0 in Status: SUCCESS [ 698.332060] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9441a081-4c23-4898-9876-4df61d261ed0 deletion is rescheduled due to dependency. [ 698.332060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9441a081-4c23-4898-9876-4df61d261ed0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.398836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.402151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.402151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.402151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.402151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.402151] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2318731e-002c-4571-ab62-1b638db2e584 already deleted. [ 698.402151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2318731e-002c-4571-ab62-1b638db2e584" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.778711] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.779022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.779105] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.779332] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.779485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.779658] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 9e2618bf-9381-4ce3-80e3-a992bd316ac5 not found, creating... [ 698.779966] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.780175] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.780391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.780584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.780759] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.781143] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.781356] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.781483] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.781755] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.782060] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.782260] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 9e2618bf-9381-4ce3-80e3-a992bd316ac5 is going to be created. [ 698.808571] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.808876] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.809706] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.809706] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.809706] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.809937] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.603569] env[65511]: INFO networking_nsxv3.common.synchronization [req-7157bfbc-9572-40c6-b5b6-595aeeb665c4 req-b0cf8b28-5a66-45d7-8d11-3e9ca86aef0d service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 699.603825] env[65511]: INFO networking_nsxv3.common.synchronization [req-7157bfbc-9572-40c6-b5b6-595aeeb665c4 req-b0cf8b28-5a66-45d7-8d11-3e9ca86aef0d service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 699.603893] env[65511]: INFO networking_nsxv3.common.synchronization [req-7157bfbc-9572-40c6-b5b6-595aeeb665c4 req-b0cf8b28-5a66-45d7-8d11-3e9ca86aef0d service nova] Enqueued Resource ID: 9e2618bf-9381-4ce3-80e3-a992bd316ac5 with Priority: HIGHEST for action port [ 699.604485] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 699.605123] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 699.605123] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2618bf-9381-4ce3-80e3-a992bd316ac5 with Priority: HIGHEST for action port [ 699.605325] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.605397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.605470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.605874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.605874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.606824] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.607081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.607081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.607211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.607355] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.607475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.607513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.607750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.607750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.608032] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.608893] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2618bf-9381-4ce3-80e3-a992bd316ac5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.609131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.609131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.609372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.609428] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2618bf-9381-4ce3-80e3-a992bd316ac5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.623308] env[65511]: INFO networking_nsxv3.common.synchronization [None req-34c35f50-4b5b-46db-bba3-e61bab08d743 None None] Enqueued Resource ID: 8845950c-8a21-42b5-ad24-15975cc7ec23 with Priority: HIGHEST for action port [ 699.623808] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8845950c-8a21-42b5-ad24-15975cc7ec23 with Priority: HIGHEST for action port [ 699.624143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8845950c-8a21-42b5-ad24-15975cc7ec23 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.624287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8845950c-8a21-42b5-ad24-15975cc7ec23" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.624362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8845950c-8a21-42b5-ad24-15975cc7ec23" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.624648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8845950c-8a21-42b5-ad24-15975cc7ec23" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.624734] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8845950c-8a21-42b5-ad24-15975cc7ec23',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.111328] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.112936] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.113098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.113679] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2618bf-9381-4ce3-80e3-a992bd316ac5 with status ACTIVE [ 700.113864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.114445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.114585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.115124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.115124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.115124] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.117801] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.117801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.117801] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2618bf-9381-4ce3-80e3-a992bd316ac5 is going to be updated. [ 700.128181] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8845950c-8a21-42b5-ad24-15975cc7ec23 [ 700.129651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.129651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.129651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.129651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.129651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.129651] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8845950c-8a21-42b5-ad24-15975cc7ec23 already deleted. [ 700.129651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8845950c-8a21-42b5-ad24-15975cc7ec23" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.139987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.141317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.142634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.142634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.142634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.142634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2618bf-9381-4ce3-80e3-a992bd316ac5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.614253] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.116835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.117078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.117078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.117306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.117397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.117501] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 701.148202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.148353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.148424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.148639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.148800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.168319] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: UNINITIALIZED for 2s [ 703.183372] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 703.184272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.184981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.184981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.185209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.185422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.185422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.185782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.185782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.185782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.185901] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.356748] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8047c9ce-aab2-4aa0-a461-4e5506fed89f None None] Enqueued Resource ID: 615730a5-817b-4015-a321-0a422378df73 with Priority: HIGHEST for action port [ 703.357102] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 615730a5-817b-4015-a321-0a422378df73 with Priority: HIGHEST for action port [ 703.357462] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-615730a5-817b-4015-a321-0a422378df73 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.357844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-615730a5-817b-4015-a321-0a422378df73" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.358121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-615730a5-817b-4015-a321-0a422378df73" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.359114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-615730a5-817b-4015-a321-0a422378df73" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.359114] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('615730a5-817b-4015-a321-0a422378df73',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.399406] env[65511]: INFO networking_nsxv3.common.synchronization [req-d1940767-a832-43ca-98b2-11efdd15ecd8 req-c8cc9e05-3cb0-4fb0-b374-abe20f89a632 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 703.400063] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 703.400499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.400654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.400712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.400987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.401245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.401597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.401716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.401894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.402058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.402215] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.689112] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.690158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.690158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.690941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.690941] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.690941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.690941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.691289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.691289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.691387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.691564] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.691707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.691995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.691995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.692297] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.692466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.692591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.692736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.692874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.693076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.693149] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.861241] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 615730a5-817b-4015-a321-0a422378df73 [ 703.861707] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.861983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.861983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.862234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.862513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.862820] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:615730a5-817b-4015-a321-0a422378df73 already deleted. [ 703.863174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-615730a5-817b-4015-a321-0a422378df73" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.904610] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.906425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.906425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f already deleted. [ 703.906425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.946464] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.946669] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-533" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.946782] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-533" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.947257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-533" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.947706] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.947840] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.947895] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.948554] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.948554] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.948554] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.948554] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.948785] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.948785] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.948874] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.948916] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.949033] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.973029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.973029] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.973029] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.973029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-533" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.973029] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-7eecba92-4225-45a2-b8d6-965a5cb96bdc taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.973029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.973029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.973029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.973029] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecba92-4225-45a2-b8d6-965a5cb96bdc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.195963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 704.220160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.220416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.220526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.220757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.220893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.221130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.221227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.221302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.225313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.225542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.225835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.225951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.226032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.226235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.226316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.226512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.226611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.226671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.226826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.227107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.227107] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 704.305443] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.305694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.306512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.308829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.311425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.323701] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 704.481773] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.481773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.481773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.481773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.481773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.481773] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 7eecba92-4225-45a2-b8d6-965a5cb96bdc not found, creating... [ 704.481773] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.487056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.487056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.487056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.487056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.491371] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.491371] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.491371] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.491371] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.491371] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.491371] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc is going to be created. [ 704.515114] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.515408] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.515571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.515823] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.516068] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.516316] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.946470] env[65511]: INFO networking_nsxv3.common.synchronization [req-1adf1d81-fe51-41d1-8a89-d08f98abd755 req-8dbebf7a-b9df-4e87-81f8-21d041a03628 tempest-ServerRescueTestJSON-356650576 tempest-ServerRescueTestJSON-356650576-project-member] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 704.946470] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 704.946754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.946888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.946955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.947423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.947623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.947733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.947801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.947963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.948085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.948187] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.262598] env[65511]: INFO networking_nsxv3.common.synchronization [req-d1940767-a832-43ca-98b2-11efdd15ecd8 req-9847f50a-22e0-4d43-a787-7e155e25c548 service nova] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 705.262850] env[65511]: INFO networking_nsxv3.common.synchronization [req-d1940767-a832-43ca-98b2-11efdd15ecd8 req-9847f50a-22e0-4d43-a787-7e155e25c548 service nova] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 705.262949] env[65511]: INFO networking_nsxv3.common.synchronization [req-d1940767-a832-43ca-98b2-11efdd15ecd8 req-9847f50a-22e0-4d43-a787-7e155e25c548 service nova] Enqueued Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 705.263583] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 705.263923] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 705.263923] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 705.264921] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.264921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.264921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.265087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.265169] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.266375] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.266482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.266549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.267593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.267593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.267593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.267593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.267593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.268066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.268066] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.272893] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eecba92-4225-45a2-b8d6-965a5cb96bdc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.273066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.273145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.273362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.274587] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecba92-4225-45a2-b8d6-965a5cb96bdc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.451691] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.451863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.451919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.452222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.452294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.452553] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.452680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.452755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.452898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.454077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.454188] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 already deleted. [ 705.454291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.488318] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.488702] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.488702] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.489019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.489316] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.489474] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.489603] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.489859] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.490267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.490501] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.490914] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.490914] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.490914] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.491085] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.491085] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.491199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.541673] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.541673] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.541673] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.541673] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.542060] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3bfd031d-35d8-424f-9a73-d46ea3361a9a taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542234] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542343] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.542746] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543397] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bfd031d-35d8-424f-9a73-d46ea3361a9a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.632098] env[65511]: INFO networking_nsxv3.common.synchronization [req-96eef458-e508-4589-be35-0d2edd7ad09f req-975a4826-a9fe-4e59-9391-88ec292b74a8 tempest-DeleteServersAdminTestJSON-1445424325 tempest-DeleteServersAdminTestJSON-1445424325-project-member] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 705.632098] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGHEST for action security_group_members [ 705.632098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.632098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.632098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.632098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.632727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.632977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.633176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.633436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.633617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.633857] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.775759] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.779313] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.779313] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eecba92-4225-45a2-b8d6-965a5cb96bdc with status ACTIVE [ 705.779313] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.779313] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.779313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.782927] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.782927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.782927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.782927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.782927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.782927] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc is going to be updated. [ 705.808465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.808465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.808465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.808465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.808465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.808465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.049889] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.050991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.050991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.050991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.050991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.050991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3bfd031d-35d8-424f-9a73-d46ea3361a9a not found, creating... [ 706.051299] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.051299] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.051414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.051533] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.051667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.052666] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.052666] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.052904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.052989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.054120] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.054120] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3bfd031d-35d8-424f-9a73-d46ea3361a9a is going to be created. [ 706.076631] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.076631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.076631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.076631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.076631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.076631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.136261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.136418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.136491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.137136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.137184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.137321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.137396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.137481] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be updated. [ 706.182795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.182981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.183071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.183358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.183844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.200404] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: IN_PROGRESS for 2s [ 706.231351] env[65511]: INFO networking_nsxv3.common.synchronization [None req-3d86424e-209b-4e6b-8647-72e68723801d None None] Enqueued Resource ID: 050cacd0-0682-440c-bd6c-126dcb386a08 with Priority: HIGHEST for action port [ 706.232226] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 050cacd0-0682-440c-bd6c-126dcb386a08 with Priority: HIGHEST for action port [ 706.232678] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-050cacd0-0682-440c-bd6c-126dcb386a08 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.232811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-050cacd0-0682-440c-bd6c-126dcb386a08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.232881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-050cacd0-0682-440c-bd6c-126dcb386a08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.233217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-050cacd0-0682-440c-bd6c-126dcb386a08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.233321] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('050cacd0-0682-440c-bd6c-126dcb386a08',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.283135] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.339266] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 706.339266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.736889] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 050cacd0-0682-440c-bd6c-126dcb386a08 [ 706.737167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.737405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.737526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.737848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.738038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.738146] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:050cacd0-0682-440c-bd6c-126dcb386a08 already deleted. [ 706.738275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-050cacd0-0682-440c-bd6c-126dcb386a08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.788499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.788499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.788499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.788499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.788499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.788499] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be created. [ 706.820090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.820894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.821021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.821263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.821469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.835725] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: UNINITIALIZED for 2s [ 706.901071] env[65511]: INFO networking_nsxv3.common.synchronization [req-1adf1d81-fe51-41d1-8a89-d08f98abd755 req-cf06e0e9-3073-4030-8a90-a42677e5e1ee service nova] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_rules [ 706.901071] env[65511]: INFO networking_nsxv3.common.synchronization [req-1adf1d81-fe51-41d1-8a89-d08f98abd755 req-cf06e0e9-3073-4030-8a90-a42677e5e1ee service nova] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 706.901071] env[65511]: INFO networking_nsxv3.common.synchronization [req-1adf1d81-fe51-41d1-8a89-d08f98abd755 req-cf06e0e9-3073-4030-8a90-a42677e5e1ee service nova] Enqueued Resource ID: 3bfd031d-35d8-424f-9a73-d46ea3361a9a with Priority: HIGHEST for action port [ 706.902020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_rules [ 706.902020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 706.902020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bfd031d-35d8-424f-9a73-d46ea3361a9a with Priority: HIGHEST for action port [ 706.906077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.906077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.906077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.906077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.906077] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.906985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.908053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.908053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.908053] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.908723] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bfd031d-35d8-424f-9a73-d46ea3361a9a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.908834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.908896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.909075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.909153] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bfd031d-35d8-424f-9a73-d46ea3361a9a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.412154] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.413229] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.413354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.413728] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bfd031d-35d8-424f-9a73-d46ea3361a9a with status ACTIVE [ 707.413890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.413993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.414131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.414272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.414379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.414652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.414815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.414815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.414975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.416329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.416329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.416329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.416329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.416708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.418026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.418133] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bfd031d-35d8-424f-9a73-d46ea3361a9a is going to be updated. [ 707.442838] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.442986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.443043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.443273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.444046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.444046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bfd031d-35d8-424f-9a73-d46ea3361a9a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.914950] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.119185] env[65511]: INFO networking_nsxv3.common.synchronization [req-32910c0a-e153-4413-8a9e-bd9327ff0c1e req-3a9e737d-6464-4eb5-aa64-b4a11256b99d tempest-FloatingIPsAssociationNegativeTestJSON-1139033214 tempest-FloatingIPsAssociationNegativeTestJSON-1139033214-project-member] Enqueued Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 708.119185] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf with Priority: HIGHEST for action security_group_members [ 708.119862] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.120215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.120395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.123503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.123923] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.123923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.124997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.125390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.125390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.125516] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1502e09d-ef5c-4d75-b759-794a7bb5c0cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.216151] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 in Status: SUCCESS [ 708.216863] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 deletion is rescheduled due to dependency. [ 708.217021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.418753] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.418753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.419135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.419135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.419135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.419262] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be created. [ 708.448846] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.449060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.449138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.449382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.449564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.462070] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: UNINITIALIZED for 2s [ 708.628117] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.628532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.628532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.629050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.629050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.629581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.629581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.629581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.629924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.630030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.630080] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf is going to be updated. [ 708.669847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.670014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.670090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.670310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.670453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.680686] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: IN_PROGRESS for 2s [ 708.847741] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 708.847974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.849111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.849552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.849921] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.850034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.850034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.850589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.850589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.850753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.850753] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.355588] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.358199] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6ab55b0f-4fb7-4828-8e6e-aac374480efb tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 79bd6fdb-9534-473f-839c-483859f97635 with Priority: HIGHEST for action security_group_rules [ 709.359033] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79bd6fdb-9534-473f-839c-483859f97635 with Priority: HIGHEST for action security_group_rules [ 709.359123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79bd6fdb-9534-473f-839c-483859f97635 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.359321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.359426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.359722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.359813] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79bd6fdb-9534-473f-839c-483859f97635',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.453214] env[65511]: INFO networking_nsxv3.common.synchronization [None req-578c3eaa-14d4-4822-b257-a6db711c242f tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 79bd6fdb-9534-473f-839c-483859f97635 with Priority: HIGHEST for action security_group_rules [ 709.453786] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79bd6fdb-9534-473f-839c-483859f97635 with Priority: HIGHEST for action security_group_rules [ 709.454303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79bd6fdb-9534-473f-839c-483859f97635 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.454303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.859233] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dd306dd-83f9-434d-a479-235e5cd1d98f: rpc.has_security_group_logging(os_id): False [ 709.881434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.881643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.881643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.881864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.882166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.882447] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.882561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.882646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.883064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.883064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.883223] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be created. [ 709.885351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.885544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.887377] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79bd6fdb-9534-473f-839c-483859f97635 already deleted. [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.887377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.887377] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79bd6fdb-9534-473f-839c-483859f97635',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.963245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.963407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.963459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.963798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.963905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.977425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 710.412849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.413119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.413188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.413497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.413636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.414315] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79bd6fdb-9534-473f-839c-483859f97635 already deleted. [ 710.414315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79bd6fdb-9534-473f-839c-483859f97635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.474608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 710.474967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.475238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.475524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.475856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.475999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.476068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.476245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.476335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.476450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.476554] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.691833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf in Status: SUCCESS [ 710.692053] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1502e09d-ef5c-4d75-b759-794a7bb5c0cf deletion is rescheduled due to dependency. [ 710.692156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1502e09d-ef5c-4d75-b759-794a7bb5c0cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.981798] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.982083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.982278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.982435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.982667] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.982793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.982903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.983168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.983298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.983371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.983542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.983641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.983704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.983859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.984082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.984233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.984308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.984471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.984554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.984723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.984869] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.488543] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adb88e63-b602-4823-96eb-a58a3e31f8a1: rpc.has_security_group_logging(os_id): False [ 711.509469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.509469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.509469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.511342] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.511342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.511342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.511342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.511342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.511631] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.512509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.512593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.512760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.513449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.513552] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be created. [ 711.600926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.601169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.601169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.601338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.601528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.618229] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 711.836695] env[65511]: INFO networking_nsxv3.common.synchronization [req-dcd54d28-c680-4421-b5f9-5ba2f775e434 req-d062e0e7-c225-4593-a40e-8056cb961f0e tempest-ServersNegativeTestMultiTenantJSON-1735836737 tempest-ServersNegativeTestMultiTenantJSON-1735836737-project-member] Enqueued Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 711.837374] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGHEST for action security_group_members [ 711.840018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.840018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.840018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.840018] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.999956] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 711.999956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.341373] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.341567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.341651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.342062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.342226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.342532] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.342766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.342878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.345134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.345134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.345134] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 is going to be updated. [ 712.382144] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.382144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.382144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.382144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.382144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.394385] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: IN_PROGRESS for 2s [ 712.552201] env[65511]: INFO networking_nsxv3.common.synchronization [req-b40d763a-92d6-444b-822c-d62a3693bec3 req-a8883afe-5dc7-481e-bb26-155b9a6a390f tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 712.553495] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 712.553495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.553495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.553495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.553495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.553860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.555447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.555447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.555447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.555447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.555447] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.058311] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.058513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.058601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.058988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.058988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.059248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.059360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.059438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.059638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.059733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.059865] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c already deleted. [ 713.059961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.075203] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.075203] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.075203] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.075203] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.075203] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.075491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.075491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.076515] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.076760] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.077011] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.077128] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.077262] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.077386] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.077510] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.077640] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.077795] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.100128] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.100296] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.100425] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.100851] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.100920] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-6be65469-4b9d-4206-903e-9caa13e7f413 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.101075] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.101181] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.101512] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.101649] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be65469-4b9d-4206-903e-9caa13e7f413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.604237] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.604712] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.604819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.605120] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.605282] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.605450] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 6be65469-4b9d-4206-903e-9caa13e7f413 not found, creating... [ 713.605805] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.606060] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.606138] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.606398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.606559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.606866] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.607045] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.607139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.607344] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.607472] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.607607] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 6be65469-4b9d-4206-903e-9caa13e7f413 is going to be created. [ 713.631551] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 713.631895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.633550] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.633789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.633964] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.634355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.634654] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.634939] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.390902] env[65511]: INFO networking_nsxv3.common.synchronization [req-b40d763a-92d6-444b-822c-d62a3693bec3 req-f9dcc3fb-bdd9-4c15-a5e7-a9c7b5e34fe4 service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 714.391146] env[65511]: INFO networking_nsxv3.common.synchronization [req-b40d763a-92d6-444b-822c-d62a3693bec3 req-f9dcc3fb-bdd9-4c15-a5e7-a9c7b5e34fe4 service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 714.391388] env[65511]: INFO networking_nsxv3.common.synchronization [req-b40d763a-92d6-444b-822c-d62a3693bec3 req-f9dcc3fb-bdd9-4c15-a5e7-a9c7b5e34fe4 service nova] Enqueued Resource ID: 6be65469-4b9d-4206-903e-9caa13e7f413 with Priority: HIGHEST for action port [ 714.392058] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 714.392259] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 714.392390] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be65469-4b9d-4206-903e-9caa13e7f413 with Priority: HIGHEST for action port [ 714.392871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.393069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.393153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.393377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.393462] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.395496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.395706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.395862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.396285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.396370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.396484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.396570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.396942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.396942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.397074] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.397991] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be65469-4b9d-4206-903e-9caa13e7f413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.398166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.398283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.398522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.398679] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be65469-4b9d-4206-903e-9caa13e7f413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.415816] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 in Status: SUCCESS [ 714.416174] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 deletion is rescheduled due to dependency. [ 714.416641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.900600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.903710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.903710] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.903710] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6be65469-4b9d-4206-903e-9caa13e7f413 with status ACTIVE [ 714.903710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.903710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.903710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.903710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.903710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.904588] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.904752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.904830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.905103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.905234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.905472] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.905607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.905706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.907028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.907028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.907028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6be65469-4b9d-4206-903e-9caa13e7f413 is going to be updated. [ 714.933596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.933830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.933830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.934064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.934203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.934387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be65469-4b9d-4206-903e-9caa13e7f413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.022677] env[65511]: INFO networking_nsxv3.common.synchronization [req-ff2e1271-87ab-45f7-8bc2-9a50cb6791d8 req-aceb54e8-5289-4ee0-8ba5-41066d5b96fe tempest-ServerMetadataNegativeTestJSON-1001361171 tempest-ServerMetadataNegativeTestJSON-1001361171-project-member] Enqueued Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 715.024588] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 715.026530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.026530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.026530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.026530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.026530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.026814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.026848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.027368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.027368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.027368] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.409075] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.505070] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.505070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-257" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.505070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-257" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.505503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-257" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.505503] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.506856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.506856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.506856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.506856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.506856] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.506856] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.506856] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.506856] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.506856] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.506856] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.507338] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.529637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.529790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.530104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.530104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.530180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.530362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.530449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.530508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.530801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.530801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.531011] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 already deleted. [ 715.531011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.544395] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.544561] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.544842] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.544899] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-257" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.545246] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-b1bab826-c8c7-40c5-902f-333f91ac2bcd taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.545437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.545515] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.545914] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546088] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bab826-c8c7-40c5-902f-333f91ac2bcd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.917259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.917647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.917647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.917869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.917996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.918139] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be created. [ 715.942097] env[65511]: INFO networking_nsxv3.common.synchronization [req-496473b3-3601-487f-89a4-cec8a40d77b5 req-17ae2016-690d-4a77-a80f-af202091a582 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 715.942984] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 715.943039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.943981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.943981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.943981] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.949282] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.949282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.949282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.949282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.949282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.961648] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: UNINITIALIZED for 2s [ 716.050898] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.051251] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.051440] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.052553] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.052673] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.052913] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port b1bab826-c8c7-40c5-902f-333f91ac2bcd not found, creating... [ 716.053363] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.053624] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.053816] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.054209] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.054696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.055245] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.055245] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.055439] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.055655] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.055865] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.056109] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: b1bab826-c8c7-40c5-902f-333f91ac2bcd is going to be created. [ 716.080816] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081091] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.081151] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.081418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.081700] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.082164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.448073] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.448255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.448325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.448780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.448780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.449146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.449303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.449423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.450028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.450028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.450028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 716.490126] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.490587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.490587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.490587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.490716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.501746] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 716.845294] env[65511]: INFO networking_nsxv3.common.synchronization [req-ff2e1271-87ab-45f7-8bc2-9a50cb6791d8 req-7c3bab11-7859-4ae7-a646-15c94c97262d service nova] Enqueued Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_rules [ 716.845453] env[65511]: INFO networking_nsxv3.common.synchronization [req-ff2e1271-87ab-45f7-8bc2-9a50cb6791d8 req-7c3bab11-7859-4ae7-a646-15c94c97262d service nova] Enqueued Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 716.845579] env[65511]: INFO networking_nsxv3.common.synchronization [req-ff2e1271-87ab-45f7-8bc2-9a50cb6791d8 req-7c3bab11-7859-4ae7-a646-15c94c97262d service nova] Enqueued Resource ID: b1bab826-c8c7-40c5-902f-333f91ac2bcd with Priority: HIGHEST for action port [ 716.846121] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_rules [ 716.846257] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 716.846355] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1bab826-c8c7-40c5-902f-333f91ac2bcd with Priority: HIGHEST for action port [ 716.846612] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.846742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.846795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.847505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.847505] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.848939] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.849128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.852779] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.852779] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.852779] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1bab826-c8c7-40c5-902f-333f91ac2bcd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.852779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.852779] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1bab826-c8c7-40c5-902f-333f91ac2bcd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.355682] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.356035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.357794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.359348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1bab826-c8c7-40c5-902f-333f91ac2bcd with status ACTIVE [ 717.359507] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.359713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.359836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.360094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.360249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.360472] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.360728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.360850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.361125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.361257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.361485] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.361644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.362056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.362286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.362480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.363068] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1bab826-c8c7-40c5-902f-333f91ac2bcd is going to be updated. [ 717.394094] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.394277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.394363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.395641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.396882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.397182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1bab826-c8c7-40c5-902f-333f91ac2bcd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.864828] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.972100] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 717.972458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.972539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.972827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.972947] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.973059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.973128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.973284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.973368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973541] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.060036] env[65511]: INFO networking_nsxv3.common.synchronization [req-77266cdb-ffeb-4d2f-93b5-0c540e8d20ec req-4d894508-28ca-4843-8bc1-8aec5a6af3c2 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 718.060036] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 718.060036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.060036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.060036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.064303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.064548] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.064798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.064798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.064929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.065503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.065503] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.370279] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.370279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.370279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.370279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.370279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.370279] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 is going to be created. [ 718.403371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.403732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.403983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.404341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.405207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.417643] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: UNINITIALIZED for 2s [ 718.477600] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.516139] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 718.516614] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 718.516614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.568137] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.759405] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6024513a-c298-464f-a336-86c243dac98d None None] Enqueued Resource ID: 453f3b17-9d44-4c5e-acb7-5b12d2daef38 with Priority: HIGHEST for action port [ 718.760172] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453f3b17-9d44-4c5e-acb7-5b12d2daef38 with Priority: HIGHEST for action port [ 718.761237] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-453f3b17-9d44-4c5e-acb7-5b12d2daef38 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.761386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453f3b17-9d44-4c5e-acb7-5b12d2daef38" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.761457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453f3b17-9d44-4c5e-acb7-5b12d2daef38" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.761813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453f3b17-9d44-4c5e-acb7-5b12d2daef38" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.762483] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453f3b17-9d44-4c5e-acb7-5b12d2daef38',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.776231] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.776445] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.776594] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.776984] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.777767] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.778562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.778562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.778562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.778995] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.779250] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.780603] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.780861] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.781043] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.781291] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.781493] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.781686] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.808520] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.809039] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.809134] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.809384] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-819" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.809880] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-910fc704-389a-4b85-a236-d4f188ee525e taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.810166] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.810365] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.810852] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.812118] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('910fc704-389a-4b85-a236-d4f188ee525e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.982721] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0f00d64-0787-45ef-b61c-8c6c22be615c: rpc.has_security_group_logging(os_id): False [ 719.002129] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.002341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.002836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.002836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.002836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.003046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.003161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.003161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.003608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.003608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.003608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be created. [ 719.070009] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.073841] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.074048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.074155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.074437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.074695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.090186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 719.266513] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 453f3b17-9d44-4c5e-acb7-5b12d2daef38 [ 719.266864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.267039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.267114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.267303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.267396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.267594] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:453f3b17-9d44-4c5e-acb7-5b12d2daef38 already deleted. [ 719.267771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453f3b17-9d44-4c5e-acb7-5b12d2daef38" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.315807] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.316121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.316872] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.316872] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.317090] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.318169] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 910fc704-389a-4b85-a236-d4f188ee525e not found, creating... [ 719.318478] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.318649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.318765] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.319026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.319832] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.319832] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.319832] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.319832] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.320097] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.320126] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.320255] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 910fc704-389a-4b85-a236-d4f188ee525e is going to be created. [ 719.376601] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.377031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.377189] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.377467] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.377702] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.377984] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.573252] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.573525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.573525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.573768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.573938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.574040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 719.615966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.616207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.616325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.616631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.616844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.628202] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [req-77266cdb-ffeb-4d2f-93b5-0c540e8d20ec req-f37586ea-da09-4dd9-b5e8-850216a13f2c service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [req-77266cdb-ffeb-4d2f-93b5-0c540e8d20ec req-f37586ea-da09-4dd9-b5e8-850216a13f2c service nova] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [req-77266cdb-ffeb-4d2f-93b5-0c540e8d20ec req-f37586ea-da09-4dd9-b5e8-850216a13f2c service nova] Enqueued Resource ID: 910fc704-389a-4b85-a236-d4f188ee525e with Priority: HIGHEST for action port [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_rules [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 720.062201] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910fc704-389a-4b85-a236-d4f188ee525e with Priority: HIGHEST for action port [ 720.062201] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.062201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.062201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.062201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.065692] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.069077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.069077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.069077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-910fc704-389a-4b85-a236-d4f188ee525e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.069077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.069077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.069077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.069077] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('910fc704-389a-4b85-a236-d4f188ee525e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.434222] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: SUCCESS [ 720.434222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.434538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.434588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.434866] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.435043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.435124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.435358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.435450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.435541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.435635] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.572866] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.573099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.573218] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 910fc704-389a-4b85-a236-d4f188ee525e with status ACTIVE [ 720.573392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.573488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.573554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.573800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.573878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.574067] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.574296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.574296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.574431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.574478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.574691] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.574782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.574853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.575029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.575127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.575208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 910fc704-389a-4b85-a236-d4f188ee525e is going to be updated. [ 720.605972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.606222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.606323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.606561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.606773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.606970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-910fc704-389a-4b85-a236-d4f188ee525e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.938499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.938499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.938499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.938852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.938902] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.939044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.939094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.939308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.939405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.939461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.939611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.939707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.939806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.939963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.940114] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.940202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.940262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.940402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.940480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.940561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.940647] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.106643] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 721.107266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.172918] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6c3d5263-53be-4d7f-90e0-cc1557676a84 None None] Enqueued Resource ID: 8fc464a2-ab28-42a5-93b7-15104b1ddb56 with Priority: HIGHEST for action port [ 721.172918] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fc464a2-ab28-42a5-93b7-15104b1ddb56 with Priority: HIGHEST for action port [ 721.173425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fc464a2-ab28-42a5-93b7-15104b1ddb56 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.173561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fc464a2-ab28-42a5-93b7-15104b1ddb56" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.173626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fc464a2-ab28-42a5-93b7-15104b1ddb56" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.174222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fc464a2-ab28-42a5-93b7-15104b1ddb56" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.174370] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fc464a2-ab28-42a5-93b7-15104b1ddb56',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.447815] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 964f8cb2-18ad-4766-ae61-bda439ab5514: rpc.has_security_group_logging(os_id): False [ 721.465794] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.466187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.466187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.466543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.467556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.468550] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.468928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.468928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.468928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.469103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.471049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.471356] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.472218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.472298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.472483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.472585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.472705] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 is going to be created. [ 721.543419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.543419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.543419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.543419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.543419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.560434] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: IN_PROGRESS for 2s [ 721.643526] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 721.643990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.644831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.644831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.645215] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.645332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.645435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.645878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.647087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.647087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.678973] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fc464a2-ab28-42a5-93b7-15104b1ddb56 [ 721.679333] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.679514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.679608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.680099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.680099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.680214] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fc464a2-ab28-42a5-93b7-15104b1ddb56 already deleted. [ 721.680322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fc464a2-ab28-42a5-93b7-15104b1ddb56" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.977565] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d790cd91-ff3b-434c-8720-706608f0cb97 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 721.978281] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 721.978602] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.978727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.978903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.980022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.980022] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.148939] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a1b3dea1-8562-4d96-8bdb-2d4f83211607 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 722.149161] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 722.149550] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.151023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.151023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.503419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.503809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.503809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.504169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.504258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.504571] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 already deleted. [ 722.504743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.504930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.505332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.505377] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.652892] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.055977] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.055977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.055977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.055977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.055977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.055977] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 already deleted. [ 723.055977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.155742] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.156026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.158529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.159743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.159743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.159743] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 723.211241] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.211415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.211773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.211890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.212234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.227585] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 723.578534] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: SUCCESS [ 723.578534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.777661] env[65511]: INFO networking_nsxv3.common.synchronization [None req-35afaee9-5302-4b4b-8993-581eba67448b None None] Enqueued Resource ID: 286e203c-bf15-4c85-9de5-85a56d9306f2 with Priority: HIGHEST for action port [ 723.778030] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 286e203c-bf15-4c85-9de5-85a56d9306f2 with Priority: HIGHEST for action port [ 723.778461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-286e203c-bf15-4c85-9de5-85a56d9306f2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.778675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-286e203c-bf15-4c85-9de5-85a56d9306f2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.778675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-286e203c-bf15-4c85-9de5-85a56d9306f2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.778926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-286e203c-bf15-4c85-9de5-85a56d9306f2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.779035] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('286e203c-bf15-4c85-9de5-85a56d9306f2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.858841] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1faa4c81-5897-46b9-9e60-32cdd7d2dd5c tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 723.859648] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 723.860963] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.860963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.860963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.861287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.861367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.042617] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9140f10a-fcc5-42f3-bdbb-f5634e1d0869 tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 724.042617] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 724.043379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.043722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.282421] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 286e203c-bf15-4c85-9de5-85a56d9306f2 [ 724.282826] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.283051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.283305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.283665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.283820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.283957] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:286e203c-bf15-4c85-9de5-85a56d9306f2 already deleted. [ 724.284128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-286e203c-bf15-4c85-9de5-85a56d9306f2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.386710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.387466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.388373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.388373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.388373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.388373] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 already deleted. [ 724.388373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.389204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.389204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.389204] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.911761] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.912196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.916155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.916513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.916660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.916734] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 already deleted. [ 724.916824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.061603] env[65511]: INFO networking_nsxv3.common.synchronization [req-3cf4d8f0-dad6-490b-8d0c-e6debca0bbdd req-14a8ed09-7c8b-453f-857e-38b43f7d55b0 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 725.062525] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 725.062525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.062670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.062670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.063589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.063795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.063889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.063954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.064150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.065253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.065377] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.242744] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 725.243592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.243592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.243592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.243719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.243719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.243837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.244031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.244170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.244233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.245056] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.481935] env[65511]: INFO networking_nsxv3.common.synchronization [req-37c827b9-15f0-4e38-bcef-82b5e46da911 req-c5711403-6c08-4ee7-9821-16d7d78316c6 tempest-FloatingIPsAssociationTestJSON-861519946 tempest-FloatingIPsAssociationTestJSON-861519946-project-member] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 725.484902] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 725.484902] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.485069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.485121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.485305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.485467] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.485570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.485658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.487737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.488160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.489726] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.567345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.567694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.567694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.567939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.568087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.568309] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.568442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.568583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.568722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.568839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.568950] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 725.633443] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.633443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.633443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.633443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.633727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.650680] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 725.747616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.747616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.747869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.749333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.750083] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.750083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.750083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.750267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.750528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.750528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.750776] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.750849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.750849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.751069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.752215] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.752215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.752215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.752215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.752215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.752215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.752215] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.830119] env[65511]: INFO networking_nsxv3.common.synchronization [req-1508cfb8-54cf-4e6c-936e-02ad451ea09b req-56ce1d60-5f8b-4cf8-bcb4-049a3a6fe268 tempest-ImagesOneServerTestJSON-1873038650 tempest-ImagesOneServerTestJSON-1873038650-project-member] Enqueued Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 725.831130] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 725.831225] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.831357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.831357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.832497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.832497] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.832497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.832497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.832497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.832497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.832497] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.991787] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.254547] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95d278ea-5c85-431d-b2c5-e2b81a141e5f: rpc.has_security_group_logging(os_id): False [ 726.262441] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-511" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-511" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-511" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.262441] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.262441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.262441] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.262441] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.263227] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.263227] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.263227] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.263227] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.263227] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.279885] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.280710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.280816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.281053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.283151] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.283151] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.283151] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.283151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.284644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.284644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.284644] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 726.293233] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.293233] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.293233] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.293415] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-511" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.293747] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-705ee88e-f24d-4661-ac7c-7d0478ab4d57 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.294069] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.294069] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.294404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.295199] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705ee88e-f24d-4661-ac7c-7d0478ab4d57',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.337348] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.337348] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.337348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.337348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 already deleted. [ 726.337734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.376696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.376921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.377030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.377989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.377989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.398460] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 726.496506] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.798872] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.799402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.799402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.799633] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.799823] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.800031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 705ee88e-f24d-4661-ac7c-7d0478ab4d57 not found, creating... [ 726.800325] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.800510] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.800695] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.801020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.801143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.801487] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.801675] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.801963] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.802565] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.803178] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.803474] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 705ee88e-f24d-4661-ac7c-7d0478ab4d57 is going to be created. [ 726.834857] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.834857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.834857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.835083] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.836192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.836192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.886450] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9028a0e6-725a-4b9f-925e-72e1ce7c1337 None None] Enqueued Resource ID: 8db3fd09-e1b7-4f9a-b296-23e3c409f24d with Priority: HIGHEST for action port [ 726.887544] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8db3fd09-e1b7-4f9a-b296-23e3c409f24d with Priority: HIGHEST for action port [ 726.887891] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8db3fd09-e1b7-4f9a-b296-23e3c409f24d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.888035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8db3fd09-e1b7-4f9a-b296-23e3c409f24d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.888107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8db3fd09-e1b7-4f9a-b296-23e3c409f24d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.888378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8db3fd09-e1b7-4f9a-b296-23e3c409f24d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.888464] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db3fd09-e1b7-4f9a-b296-23e3c409f24d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.999452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.999861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.999861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.999861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.000040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.000083] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be updated. [ 727.044421] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.044612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.044696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.044951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.045116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.059985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 727.391657] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8db3fd09-e1b7-4f9a-b296-23e3c409f24d [ 727.391657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.391657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.391657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.391657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.391657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.391657] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8db3fd09-e1b7-4f9a-b296-23e3c409f24d already deleted. [ 727.391657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8db3fd09-e1b7-4f9a-b296-23e3c409f24d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.565262] env[65511]: INFO networking_nsxv3.common.synchronization [req-1508cfb8-54cf-4e6c-936e-02ad451ea09b req-4d45d9ff-ce9d-456e-8446-baec9775dc07 service nova] Enqueued Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_rules [ 727.565450] env[65511]: INFO networking_nsxv3.common.synchronization [req-1508cfb8-54cf-4e6c-936e-02ad451ea09b req-4d45d9ff-ce9d-456e-8446-baec9775dc07 service nova] Enqueued Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 727.566843] env[65511]: INFO networking_nsxv3.common.synchronization [req-1508cfb8-54cf-4e6c-936e-02ad451ea09b req-4d45d9ff-ce9d-456e-8446-baec9775dc07 service nova] Enqueued Resource ID: 705ee88e-f24d-4661-ac7c-7d0478ab4d57 with Priority: HIGHEST for action port [ 727.568419] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_rules [ 727.568419] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 727.568419] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705ee88e-f24d-4661-ac7c-7d0478ab4d57 with Priority: HIGHEST for action port [ 727.568419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.568419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.568419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.568419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.568897] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.570212] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.571160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.571160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.571160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.571160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.571160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.571160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.571430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.571430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.571430] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.572302] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-705ee88e-f24d-4661-ac7c-7d0478ab4d57 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.572400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.572477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.572737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.572788] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('705ee88e-f24d-4661-ac7c-7d0478ab4d57',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.662897] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 727.663077] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 deletion is rescheduled due to dependency. [ 727.663240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.075681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.075681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.076187] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.077096] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 705ee88e-f24d-4661-ac7c-7d0478ab4d57 with status ACTIVE [ 728.077096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.077096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.077096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.077364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.077364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.077436] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.077868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.077868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.077868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.077868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.079733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.080510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.080510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.080608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.080691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.082229] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 705ee88e-f24d-4661-ac7c-7d0478ab4d57 is going to be updated. [ 728.107048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.107250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.107316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.107475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.107617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.107780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-705ee88e-f24d-4661-ac7c-7d0478ab4d57" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.415937] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 728.416228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.583450] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.787643] env[65511]: INFO networking_nsxv3.common.synchronization [None req-2af40dd3-801f-4d2a-b031-784aa7526a94 None None] Enqueued Resource ID: f5e33632-9ab4-40be-bfad-a8a9b3aaf344 with Priority: HIGHEST for action port [ 728.788264] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e33632-9ab4-40be-bfad-a8a9b3aaf344 with Priority: HIGHEST for action port [ 728.788664] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e33632-9ab4-40be-bfad-a8a9b3aaf344 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.788828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e33632-9ab4-40be-bfad-a8a9b3aaf344" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.788828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e33632-9ab4-40be-bfad-a8a9b3aaf344" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.789172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e33632-9ab4-40be-bfad-a8a9b3aaf344" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.789269] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e33632-9ab4-40be-bfad-a8a9b3aaf344',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.074616] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 729.074616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.087874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.088187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.088187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.088360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.088445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.088553] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 is going to be created. [ 729.115861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.116128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.116229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.117722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.117722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.127264] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: UNINITIALIZED for 2s [ 729.291571] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5e33632-9ab4-40be-bfad-a8a9b3aaf344 [ 729.291805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.291947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.292052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.292318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.292410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.292504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5e33632-9ab4-40be-bfad-a8a9b3aaf344 already deleted. [ 729.292582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e33632-9ab4-40be-bfad-a8a9b3aaf344" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.145401] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f9a640fc-9d4c-4623-a340-1c62d927a923 None None] Enqueued Resource ID: 5a249acd-a431-440b-be77-13cae0b45de0 with Priority: HIGHEST for action port [ 731.145401] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: SUCCESS [ 731.146619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.147707] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a249acd-a431-440b-be77-13cae0b45de0 with Priority: HIGHEST for action port [ 731.148531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.151082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.151082] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.151082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a249acd-a431-440b-be77-13cae0b45de0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a249acd-a431-440b-be77-13cae0b45de0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.151082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a249acd-a431-440b-be77-13cae0b45de0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.151828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a249acd-a431-440b-be77-13cae0b45de0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.152090] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a249acd-a431-440b-be77-13cae0b45de0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.655416] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a249acd-a431-440b-be77-13cae0b45de0 [ 731.655416] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.655416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.655613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.656280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.656280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.656280] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a249acd-a431-440b-be77-13cae0b45de0 already deleted. [ 731.656280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a249acd-a431-440b-be77-13cae0b45de0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.656446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.656446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.656595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.656669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.658840] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.658971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.659054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.659217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.660079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.660079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.661609] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.661702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.661807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.661954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.662226] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.662361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.662461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.662832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.662922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.663027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.663087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.166264] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2342fbe7-800e-4cc9-9b5f-49749f5d38b2: rpc.has_security_group_logging(os_id): False [ 732.190160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.190534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.190712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.190994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.191830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.192098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.192244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.192313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.192500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.192601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.192831] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.192932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.192993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.193188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.193268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.193465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.193568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.193655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.193829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.193910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.193997] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 is going to be created. [ 732.277754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.277950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.278085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.278361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.278619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.296565] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: IN_PROGRESS for 2s [ 733.062160] env[65511]: INFO networking_nsxv3.common.synchronization [req-49dc9c25-fcb7-404b-a66f-9541edb20561 req-281dcfff-88d4-4a85-9812-dd871112fcc6 tempest-ServersAdminNegativeTestJSON-511239178 tempest-ServersAdminNegativeTestJSON-511239178-project-member] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 733.062160] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 733.066349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.066914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.069419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.069419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.070909] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.574124] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.679026] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.679026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.679026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.681424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.681424] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.681424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.681424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.681424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.681424] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.681424] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.681424] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.681857] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.681857] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.681932] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.682077] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.683221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.703495] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.703693] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.703854] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.704072] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.704427] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.704633] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.704757] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.705201] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.705376] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.075357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.207485] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.207755] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.207815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.208107] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.208253] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.208401] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 not found, creating... [ 734.208662] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.208866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.208992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.209236] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.209361] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.209639] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.209786] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.209893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.210105] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.210237] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.210423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 is going to be created. [ 734.234071] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.234280] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.234447] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.234912] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.235175] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.235394] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.316485] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: SUCCESS [ 734.316840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.579341] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.579670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.579670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.579875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.580016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.580163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be updated. [ 734.625322] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.625322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.625322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.625546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.625617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.638794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 734.933056] env[65511]: INFO networking_nsxv3.common.synchronization [req-49dc9c25-fcb7-404b-a66f-9541edb20561 req-9d4fabe3-0546-459a-964f-9ac0c472297b service nova] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_rules [ 734.933236] env[65511]: INFO networking_nsxv3.common.synchronization [req-49dc9c25-fcb7-404b-a66f-9541edb20561 req-9d4fabe3-0546-459a-964f-9ac0c472297b service nova] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 734.933361] env[65511]: INFO networking_nsxv3.common.synchronization [req-49dc9c25-fcb7-404b-a66f-9541edb20561 req-9d4fabe3-0546-459a-964f-9ac0c472297b service nova] Enqueued Resource ID: b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 with Priority: HIGHEST for action port [ 734.933880] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_rules [ 734.934027] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 734.934109] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 with Priority: HIGHEST for action port [ 734.934463] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.934596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.934667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.934891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.934957] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.937949] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.938075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.938280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.938381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.938445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.938637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.938717] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.441681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.442146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.444457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 with status ACTIVE [ 735.446301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.446301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.446301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.446301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.447786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.447786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.447786] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508 is going to be updated. [ 735.474145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.474348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.474473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.474752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.474916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.475156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2f5e0d4-f6cd-428b-9d3b-9aadb91c4508" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.651573] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 736.651573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.651573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.651573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.651573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.651573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.651573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.652529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.652529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.652529] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.155238] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.659148] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.835345] env[65511]: INFO networking_nsxv3.common.synchronization [req-540f0485-8197-47ba-8076-e6cd77e7324c req-9c430274-2609-4991-9049-86edb62e0d61 tempest-SecurityGroupRulesNegativeTestJSON-2116661596 tempest-SecurityGroupRulesNegativeTestJSON-2116661596-project-member] Enqueued Resource ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 with Priority: HIGHEST for action security_group_rules [ 737.836296] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 with Priority: HIGHEST for action security_group_rules [ 737.836719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.836835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.837291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.838317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.839018] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12824b4f-8eed-4cdc-bdd9-2af28209d1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.025921] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f84895c7-fe46-4ded-94d9-0f766af542ad None None] Enqueued Resource ID: 0d4ea8e4-d8ff-4c31-8504-bfd31612c959 with Priority: HIGHEST for action port [ 738.026699] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4ea8e4-d8ff-4c31-8504-bfd31612c959 with Priority: HIGHEST for action port [ 738.026970] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d4ea8e4-d8ff-4c31-8504-bfd31612c959 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.027186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d4ea8e4-d8ff-4c31-8504-bfd31612c959" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.027329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d4ea8e4-d8ff-4c31-8504-bfd31612c959" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.027763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d4ea8e4-d8ff-4c31-8504-bfd31612c959" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.027878] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4ea8e4-d8ff-4c31-8504-bfd31612c959',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.161684] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.162053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.162053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.162169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.162215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.162320] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be updated. [ 738.195681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.195996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.196114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.196356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.196585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.208099] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 738.364090] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.365124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.365124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.365124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.365124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.365124] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 already deleted. [ 738.365519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.530794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d4ea8e4-d8ff-4c31-8504-bfd31612c959 [ 738.531120] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.531991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.531991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.531991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.531991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.531991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d4ea8e4-d8ff-4c31-8504-bfd31612c959 already deleted. [ 738.531991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d4ea8e4-d8ff-4c31-8504-bfd31612c959" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.522656] env[65511]: INFO networking_nsxv3.common.synchronization [None req-84fd7435-4bb1-4ac9-835f-a1406b39d951 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 with Priority: HIGHEST for action security_group_rules [ 739.523335] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 with Priority: HIGHEST for action security_group_rules [ 739.523657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.523781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.523848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.526218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.526312] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe1c89e-5e19-42ec-b840-cf03d5f7f246',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.688690] env[65511]: INFO networking_nsxv3.common.synchronization [None req-08271580-df3d-40a4-8825-7937fb7a08f8 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 with Priority: HIGHEST for action security_group_rules [ 739.688690] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 with Priority: HIGHEST for action security_group_rules [ 739.688690] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.688690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.051412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.051628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.051628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.051825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.051911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.052028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 already deleted. [ 740.052111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.052266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.052425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.052528] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe1c89e-5e19-42ec-b840-cf03d5f7f246',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.221238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 740.222967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.222967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.223130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.223287] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.223412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.223483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.223674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.224322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.224322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.224322] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.589178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.589534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.589534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.589658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.589751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.589852] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe1c89e-5e19-42ec-b840-cf03d5f7f246 already deleted. [ 740.589987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe1c89e-5e19-42ec-b840-cf03d5f7f246" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.729998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.729998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.729998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.730605] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.730605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.730605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.730605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.730605] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.730605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.730605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.730812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.730812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.730901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.732030] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.803951] env[65511]: INFO networking_nsxv3.common.synchronization [req-efa48e89-414f-4796-9ef4-9ee68472b766 req-ba71c325-289c-43ba-8b84-1973dffc4504 tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 740.808364] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 740.809265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.809750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.810059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.810555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.810973] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.813020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.813020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.813020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.813020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.813020] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.126807] env[65511]: INFO networking_nsxv3.common.synchronization [None req-66d5ba1d-d9e3-4ff9-8f15-1d5791f30b79 None None] Enqueued Resource ID: cd7904a7-2fa1-49cc-aca3-7a4577e9ed04 with Priority: HIGHEST for action port [ 741.129194] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd7904a7-2fa1-49cc-aca3-7a4577e9ed04 with Priority: HIGHEST for action port [ 741.129620] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd7904a7-2fa1-49cc-aca3-7a4577e9ed04 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.129818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd7904a7-2fa1-49cc-aca3-7a4577e9ed04" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.129879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd7904a7-2fa1-49cc-aca3-7a4577e9ed04" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.130586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd7904a7-2fa1-49cc-aca3-7a4577e9ed04" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.130701] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd7904a7-2fa1-49cc-aca3-7a4577e9ed04',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.236101] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0: rpc.has_security_group_logging(os_id): False [ 741.254493] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.254817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.255199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.255253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.255453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.255702] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.255702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.255822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.256206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.256269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.256497] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.256581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.256651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.256799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.256875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.257121] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.257327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.257418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.257599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.257779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.257879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be updated. [ 741.316143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.316143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.316143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.316422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.316422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.316630] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.316866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.316866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.316969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.317064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.317169] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 741.341265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.342315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.342315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.342597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.343321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.353136] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.353352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.353352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.353613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.353791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.358663] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 741.367249] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 741.438826] env[65511]: INFO networking_nsxv3.common.synchronization [req-42ab3491-6f9a-47c8-8e27-61db0b487bb5 req-df6c26a8-6bcf-4d07-b97a-72c96d59619e tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 741.440277] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 741.441010] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.441412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.441494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.441897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.442191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.442361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.442465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.442973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.443064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.443226] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.633608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd7904a7-2fa1-49cc-aca3-7a4577e9ed04 [ 741.633608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.634651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.634651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.634651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.634651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.634651] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd7904a7-2fa1-49cc-aca3-7a4577e9ed04 already deleted. [ 741.634651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd7904a7-2fa1-49cc-aca3-7a4577e9ed04" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.896465] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.896707] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.896855] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.897172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.897462] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.897659] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.897781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.898056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.898231] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.898465] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.898604] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.898760] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 741.899099] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 741.899099] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.899187] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 741.899325] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.919345] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.919531] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.919673] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.919845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.920193] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-c713c450-3c80-42c9-b4f4-2009f1a73044 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.920361] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.920490] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.921220] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.921220] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c713c450-3c80-42c9-b4f4-2009f1a73044',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.946271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.946484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.946484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.946704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.946794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.946982] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.947113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.947170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.947422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.947422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.947422] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 already deleted. [ 741.947623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.973887] env[65511]: INFO networking_nsxv3.common.synchronization [None req-37ccb68d-56da-418f-9841-36856db83dca tempest-ServersTestFqdnHostnames-9397888 tempest-ServersTestFqdnHostnames-9397888-project-member] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 741.974398] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 741.975989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.975989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.975989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.975989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.975989] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.424202] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.425029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.425029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.425649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.425649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.425649] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port c713c450-3c80-42c9-b4f4-2009f1a73044 not found, creating... [ 742.426077] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.426254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.426392] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.426785] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.426961] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.427354] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.427543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.427628] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.427847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.427997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.428177] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: c713c450-3c80-42c9-b4f4-2009f1a73044 is going to be created. [ 742.450157] env[65511]: INFO networking_nsxv3.common.synchronization [req-ffa8acee-fabe-4e49-a5cb-b585a30d9add req-184a511a-c2c8-4b8d-8ba5-1f8e72d92249 tempest-ServersV294TestFqdnHostnames-358523912 tempest-ServersV294TestFqdnHostnames-358523912-project-member] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 742.451369] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.451549] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.451660] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.451933] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.452222] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.452447] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.453520] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGHEST for action security_group_members [ 742.454026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.454154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.454222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.454404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.454550] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.454648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.454739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.454975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.455117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.455212] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.500773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.500967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.501151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.501279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.501439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.501615] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 already deleted. [ 742.501647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.802237] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e4584672-3576-456a-8384-463af8e05572 tempest-ServersTestFqdnHostnames-9397888 tempest-ServersTestFqdnHostnames-9397888-project-member] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 742.802851] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 742.803392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.803533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.803603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.803895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.803996] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.960668] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.960668] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.960668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.960668] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf is going to be updated. [ 743.006227] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.006368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.006452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.006655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.006827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.019978] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: IN_PROGRESS for 2s [ 743.254523] env[65511]: INFO networking_nsxv3.common.synchronization [req-42ab3491-6f9a-47c8-8e27-61db0b487bb5 req-54768dfb-b48e-45dd-9558-476f77eacb55 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 743.254767] env[65511]: INFO networking_nsxv3.common.synchronization [req-42ab3491-6f9a-47c8-8e27-61db0b487bb5 req-54768dfb-b48e-45dd-9558-476f77eacb55 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 743.254932] env[65511]: INFO networking_nsxv3.common.synchronization [req-42ab3491-6f9a-47c8-8e27-61db0b487bb5 req-54768dfb-b48e-45dd-9558-476f77eacb55 service nova] Enqueued Resource ID: c713c450-3c80-42c9-b4f4-2009f1a73044 with Priority: HIGHEST for action port [ 743.256805] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 743.256980] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 743.257120] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713c450-3c80-42c9-b4f4-2009f1a73044 with Priority: HIGHEST for action port [ 743.257595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.257734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.257805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.258234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.258333] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.259640] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.259884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.260246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.260614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.260913] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.261178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.261250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.261461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.261564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.261750] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.263427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c713c450-3c80-42c9-b4f4-2009f1a73044 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.263561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.263640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.263810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.263944] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c713c450-3c80-42c9-b4f4-2009f1a73044',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.328527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.329403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.329530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.329770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.329869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.329970] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 already deleted. [ 743.330080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.377612] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 743.377805] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 deletion is rescheduled due to dependency. [ 743.377939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.381264] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 743.381509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.598905] env[65511]: INFO networking_nsxv3.common.synchronization [req-57b4c55e-8ffa-4549-ba12-34a3cd2edbf1 req-e00f1e24-c275-4f12-addb-242ba685d5dd tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 743.598905] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 743.598905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.598905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.598905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.598905] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.766178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.767429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.767429] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.767429] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c713c450-3c80-42c9-b4f4-2009f1a73044 with status ACTIVE [ 743.767605] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.767761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.767812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.768402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.768402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.768402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.768402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.768402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.768757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.768757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.768868] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.768963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.769158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.769918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.769918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.769918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c713c450-3c80-42c9-b4f4-2009f1a73044 is going to be updated. [ 743.792037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.792202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.792269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.792481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.792620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.792781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c713c450-3c80-42c9-b4f4-2009f1a73044" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.955185] env[65511]: INFO networking_nsxv3.common.synchronization [req-db1d3862-54f3-4ecc-8978-e88121fc6f70 req-f69241d1-f15f-47d1-8fc6-c9648950ded4 tempest-SecurityGroupRulesNegativeTestJSON-2116661596 tempest-SecurityGroupRulesNegativeTestJSON-2116661596-project-member] Enqueued Resource ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 with Priority: HIGHEST for action security_group_rules [ 743.955811] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 with Priority: HIGHEST for action security_group_rules [ 743.956562] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.956761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.956855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.957079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.957177] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12824b4f-8eed-4cdc-bdd9-2af28209d1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.011033] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.011374] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.011580] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.012877] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.013603] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.013894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.014109] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.014507] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.014738] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.015100] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.015299] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.015481] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.015672] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.015850] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.016056] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.016274] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.050505] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.050761] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.050937] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.051164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.051548] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-136bef2d-7908-4a4a-8e1c-bbd57b441c42 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.051756] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.051954] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.052406] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.052629] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136bef2d-7908-4a4a-8e1c-bbd57b441c42',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.100970] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.101244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.101316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.101545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.101643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.101861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.101968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.102039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.102198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.102275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.102357] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 already deleted. [ 744.102434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.271120] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.490113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.490113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.490113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.490113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.490113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.490113] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12824b4f-8eed-4cdc-bdd9-2af28209d1d8 already deleted. [ 744.490113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12824b4f-8eed-4cdc-bdd9-2af28209d1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.555451] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.555822] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.555983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.556334] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.556494] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.556663] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 136bef2d-7908-4a4a-8e1c-bbd57b441c42 not found, creating... [ 744.557123] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.557412] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.557517] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.557784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.557946] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.558333] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.558537] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.558730] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.558941] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.559108] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.559264] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 136bef2d-7908-4a4a-8e1c-bbd57b441c42 is going to be created. [ 744.582115] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.583414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.583414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.583414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.583414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.583852] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.774307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.774501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.774560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.774760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.774849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.775077] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be created. [ 744.801592] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.801822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.801928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.802198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.802404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.813424] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: UNINITIALIZED for 2s [ 745.030993] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf in Status: SUCCESS [ 745.031294] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf deletion is rescheduled due to dependency. [ 745.031342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.292179] env[65511]: INFO networking_nsxv3.common.synchronization [req-57b4c55e-8ffa-4549-ba12-34a3cd2edbf1 req-64f5346b-340d-413c-a512-1a73d7507e6b service nova] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 745.293018] env[65511]: INFO networking_nsxv3.common.synchronization [req-57b4c55e-8ffa-4549-ba12-34a3cd2edbf1 req-64f5346b-340d-413c-a512-1a73d7507e6b service nova] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 745.293018] env[65511]: INFO networking_nsxv3.common.synchronization [req-57b4c55e-8ffa-4549-ba12-34a3cd2edbf1 req-64f5346b-340d-413c-a512-1a73d7507e6b service nova] Enqueued Resource ID: 136bef2d-7908-4a4a-8e1c-bbd57b441c42 with Priority: HIGHEST for action port [ 745.293189] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 745.293454] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 745.293565] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136bef2d-7908-4a4a-8e1c-bbd57b441c42 with Priority: HIGHEST for action port [ 745.294422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.294422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.294422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.294422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.294570] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.296645] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.297784] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.297784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.297784] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.299057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-136bef2d-7908-4a4a-8e1c-bbd57b441c42 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.299057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.299057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.299269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.299269] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136bef2d-7908-4a4a-8e1c-bbd57b441c42',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.553315] env[65511]: INFO networking_nsxv3.common.synchronization [req-05c970be-39f7-43e6-9ff1-39648b674528 req-daa516f8-d906-48b7-9709-a1bbbe850699 tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 745.554880] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 745.557394] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557394] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.557394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.557394] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.803909] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.804985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.805363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.805619] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 136bef2d-7908-4a4a-8e1c-bbd57b441c42 with status ACTIVE [ 745.805889] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.806158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.806301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.806581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.806757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.808111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.808111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.808111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.809209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.810608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.810608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 136bef2d-7908-4a4a-8e1c-bbd57b441c42 is going to be updated. [ 745.832255] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.832558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.832558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.832749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.832843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.833035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-136bef2d-7908-4a4a-8e1c-bbd57b441c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.054110] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.054110] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.054110] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.054737] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.054862] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.054999] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.055093] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.055318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.055456] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.055655] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.055764] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.055869] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.055990] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.056110] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.057516] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.057696] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.059779] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.059835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.059891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.060071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.060161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.060341] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.060434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.060495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.060634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.060755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.061679] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 already deleted. [ 746.061679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.079691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.079875] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.080023] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.080205] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.080517] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3788dd1b-bd57-46b1-94be-bcf087a2804b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.080700] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.080814] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.081161] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.081295] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3788dd1b-bd57-46b1-94be-bcf087a2804b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.308510] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.587021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.587021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.587021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.587928] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.588115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.588346] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3788dd1b-bd57-46b1-94be-bcf087a2804b not found, creating... [ 746.588653] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.588820] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.588928] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.590158] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.590584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.593346] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.593346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.593346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.593346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.593581] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.593773] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3788dd1b-bd57-46b1-94be-bcf087a2804b is going to be created. [ 746.620161] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.620577] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.620577] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.623525] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.623525] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.623525] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.811250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.811511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.811511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.811721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.811813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.811914] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be created. [ 746.825255] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 746.825255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.825255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.825255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.825492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.825492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.825492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.825718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.825718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.825802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.826264] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.838218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.838444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.838444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.838625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.838783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.851065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: UNINITIALIZED for 2s [ 746.911427] env[65511]: INFO networking_nsxv3.common.synchronization [None req-badb905d-43c5-453c-aa65-c4e20f1eb365 None None] Enqueued Resource ID: 031c3e5e-9911-4cdf-9345-356c023f4c8e with Priority: HIGHEST for action port [ 746.912169] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 031c3e5e-9911-4cdf-9345-356c023f4c8e with Priority: HIGHEST for action port [ 746.912482] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-031c3e5e-9911-4cdf-9345-356c023f4c8e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.912604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-031c3e5e-9911-4cdf-9345-356c023f4c8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.912679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-031c3e5e-9911-4cdf-9345-356c023f4c8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.912972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-031c3e5e-9911-4cdf-9345-356c023f4c8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.913048] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('031c3e5e-9911-4cdf-9345-356c023f4c8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.329880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.330178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.330178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.330394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.330519] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.330634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.330698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.330854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.330945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.331079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.331255] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.331414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.331589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.331730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.331828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.331897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.332059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.332134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.332213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.332306] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.391016] env[65511]: INFO networking_nsxv3.common.synchronization [req-05c970be-39f7-43e6-9ff1-39648b674528 req-8bd87cec-e2f6-4781-a0d8-653a46216b31 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 747.391252] env[65511]: INFO networking_nsxv3.common.synchronization [req-05c970be-39f7-43e6-9ff1-39648b674528 req-8bd87cec-e2f6-4781-a0d8-653a46216b31 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 747.391394] env[65511]: INFO networking_nsxv3.common.synchronization [req-05c970be-39f7-43e6-9ff1-39648b674528 req-8bd87cec-e2f6-4781-a0d8-653a46216b31 service nova] Enqueued Resource ID: 3788dd1b-bd57-46b1-94be-bcf087a2804b with Priority: HIGHEST for action port [ 747.391984] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 747.391984] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 747.391984] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3788dd1b-bd57-46b1-94be-bcf087a2804b with Priority: HIGHEST for action port [ 747.392600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.393047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.393047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.393220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.393313] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.394650] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.394778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.394846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.395032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.395190] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.395289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.395350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.395493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.395579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.395668] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.396477] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3788dd1b-bd57-46b1-94be-bcf087a2804b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.396596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.397727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.397727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.397727] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3788dd1b-bd57-46b1-94be-bcf087a2804b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.415602] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 031c3e5e-9911-4cdf-9345-356c023f4c8e [ 747.415987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.416160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.416252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.416448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.416547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.416652] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:031c3e5e-9911-4cdf-9345-356c023f4c8e already deleted. [ 747.416734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-031c3e5e-9911-4cdf-9345-356c023f4c8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.803032] env[65511]: INFO networking_nsxv3.common.synchronization [req-c95b7e0b-a98a-4cda-96f1-b6a8910a351f req-b5e45522-42ae-4de5-b7b9-c616aae8cc83 tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 747.803032] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 747.803235] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.803305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.803357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.803532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.803682] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.803781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.803850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.804010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.809115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.809115] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.837063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7e334b-4f27-4441-85ca-d5b22f8c8f07: rpc.has_security_group_logging(os_id): False [ 747.855212] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.855212] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.855212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.855669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.855669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.855669] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.855669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.855669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.855814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.855936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.856363] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.856363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.856363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.856609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.856609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.856609] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be created. [ 747.895661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.895788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.898863] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.901714] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3788dd1b-bd57-46b1-94be-bcf087a2804b with status ACTIVE [ 747.901714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.901714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.901714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.902030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.902030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.902254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.902359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.902431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.902608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.903013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.903013] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3788dd1b-bd57-46b1-94be-bcf087a2804b is going to be updated. [ 747.929466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.929681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.929791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.930133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.930297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.930515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3788dd1b-bd57-46b1-94be-bcf087a2804b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.935776] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.935960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.935960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.936528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.936528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.958409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 748.285036] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.285036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.285036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.285036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.286449] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.286624] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.286739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.287126] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.287308] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.288655] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.288861] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.288998] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.289227] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.289371] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.289517] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.289665] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.311559] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.322362] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.322362] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.322362] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.322362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.322637] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-8f4ac0db-c4d7-408c-bca6-842078a175e0 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.322895] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.323637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.323637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.323637] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f4ac0db-c4d7-408c-bca6-842078a175e0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.409308] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.814459] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.827727] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.827873] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.827905] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.828204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.828645] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.828645] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 8f4ac0db-c4d7-408c-bca6-842078a175e0 not found, creating... [ 748.828743] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.828952] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.829015] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.829186] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.829309] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.829574] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.830042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.830042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.830042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.835651] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.835651] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 8f4ac0db-c4d7-408c-bca6-842078a175e0 is going to be created. [ 748.859472] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.859675] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.859785] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.860504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.860504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.860504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.862941] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 748.863157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.865301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.865301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.865301] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.913330] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.913609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.913733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.914538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.914538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.914538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be created. [ 748.971408] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.971408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.971408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.971408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.971408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.987034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: UNINITIALIZED for 2s [ 749.321273] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.321273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.321273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.321273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.321273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.321273] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be updated. [ 749.367754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.367977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.368074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.368407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.368561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.369768] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.380756] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 749.614107] env[65511]: INFO networking_nsxv3.common.synchronization [req-c95b7e0b-a98a-4cda-96f1-b6a8910a351f req-b8366df6-da2f-43bb-985e-d2005818a4c3 service nova] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_rules [ 749.614107] env[65511]: INFO networking_nsxv3.common.synchronization [req-c95b7e0b-a98a-4cda-96f1-b6a8910a351f req-b8366df6-da2f-43bb-985e-d2005818a4c3 service nova] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 749.614107] env[65511]: INFO networking_nsxv3.common.synchronization [req-c95b7e0b-a98a-4cda-96f1-b6a8910a351f req-b8366df6-da2f-43bb-985e-d2005818a4c3 service nova] Enqueued Resource ID: 8f4ac0db-c4d7-408c-bca6-842078a175e0 with Priority: HIGHEST for action port [ 749.614704] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_rules [ 749.615254] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 749.615254] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4ac0db-c4d7-408c-bca6-842078a175e0 with Priority: HIGHEST for action port [ 749.616795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.616795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.616795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.616795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.616795] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.617793] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.617954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.618179] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f4ac0db-c4d7-408c-bca6-842078a175e0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.618290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.618370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.618621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.618677] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f4ac0db-c4d7-408c-bca6-842078a175e0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.727964] env[65511]: INFO networking_nsxv3.common.synchronization [None req-7ff7b4e3-7324-42b0-b312-5a20f9fe6827 None None] Enqueued Resource ID: 3343cdd2-94ef-49d1-aefa-806c4952e7a8 with Priority: HIGHEST for action port [ 749.728651] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3343cdd2-94ef-49d1-aefa-806c4952e7a8 with Priority: HIGHEST for action port [ 749.729080] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3343cdd2-94ef-49d1-aefa-806c4952e7a8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.729231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3343cdd2-94ef-49d1-aefa-806c4952e7a8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.729300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3343cdd2-94ef-49d1-aefa-806c4952e7a8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.729564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3343cdd2-94ef-49d1-aefa-806c4952e7a8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.729648] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3343cdd2-94ef-49d1-aefa-806c4952e7a8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.873039] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 323c831e-3e57-4559-b403-13f13a8cf909: rpc.has_security_group_logging(os_id): False [ 749.896198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.896198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.896198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.896198] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be created. [ 749.959040] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.959244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.959342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.959635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.959830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.971886] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 749.974116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 749.974331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.121075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.121526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.121526] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f4ac0db-c4d7-408c-bca6-842078a175e0 with status ACTIVE [ 750.121909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.122061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.122133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.122442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.122442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.122617] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.122718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.122773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.122935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.123025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.123401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.123401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.123401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.123614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.123614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.123751] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f4ac0db-c4d7-408c-bca6-842078a175e0 is going to be updated. [ 750.150469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.150705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.150705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.150904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.151076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.151341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f4ac0db-c4d7-408c-bca6-842078a175e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.231969] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3343cdd2-94ef-49d1-aefa-806c4952e7a8 [ 750.232321] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.232500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.232632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.232969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.233139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.233278] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3343cdd2-94ef-49d1-aefa-806c4952e7a8 already deleted. [ 750.233419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3343cdd2-94ef-49d1-aefa-806c4952e7a8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.616805] env[65511]: INFO networking_nsxv3.common.synchronization [req-63b637cd-265a-4f57-9b7b-eb8267abd9e9 req-22088b7f-9fdd-436d-abd8-0eae33072914 tempest-ServerRescueTestJSON-356650576 tempest-ServerRescueTestJSON-356650576-project-member] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 750.618879] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 750.621197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.621571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.621793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.622274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.622814] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.623132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.624017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.624017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.624017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.624017] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.997711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 750.998008] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.998235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.998514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.998773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.998930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.999034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.999257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.999366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.999480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.999600] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.123922] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.124165] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.124307] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.124618] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.124879] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.127191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.127191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.127191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.127191] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.127191] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.127518] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.127518] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.127518] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.128874] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.128874] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.128874] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.129705] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.154339] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.157375] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.157375] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.157375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-134" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.157375] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-e697b372-01a8-43de-85a2-fb89e9e0345f taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.157375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.157375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.157375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.157375] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e697b372-01a8-43de-85a2-fb89e9e0345f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.392766] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 751.393041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.393235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.393461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.393680] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.393810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.393872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.394072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.394169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.394297] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.502518] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.632365] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.659190] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.659190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.659190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.659190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.659190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.659190] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port e697b372-01a8-43de-85a2-fb89e9e0345f not found, creating... [ 751.659432] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.659569] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.659671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.659901] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.660044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.660332] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.660480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.660586] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.660796] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.660979] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.661074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: e697b372-01a8-43de-85a2-fb89e9e0345f is going to be created. [ 751.694725] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.694725] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.695043] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.695228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.695434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.695687] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.899158] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.986502] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 751.986774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.005446] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 752.024932] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.025203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.025203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.025579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.025579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.025771] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.025869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.025945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.026132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.026214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.026307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be created. [ 752.097929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.098139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.098226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.098508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.098774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.114377] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 752.138832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.139146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.139146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.139296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.139398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.139529] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 752.181948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.182500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.182500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.182500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.182639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.215013] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 752.403806] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.522775] env[65511]: INFO networking_nsxv3.common.synchronization [req-63b637cd-265a-4f57-9b7b-eb8267abd9e9 req-62f6b537-2263-48aa-9269-bb67d38bf5fd service nova] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_rules [ 752.522775] env[65511]: INFO networking_nsxv3.common.synchronization [req-63b637cd-265a-4f57-9b7b-eb8267abd9e9 req-62f6b537-2263-48aa-9269-bb67d38bf5fd service nova] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 752.522775] env[65511]: INFO networking_nsxv3.common.synchronization [req-63b637cd-265a-4f57-9b7b-eb8267abd9e9 req-62f6b537-2263-48aa-9269-bb67d38bf5fd service nova] Enqueued Resource ID: e697b372-01a8-43de-85a2-fb89e9e0345f with Priority: HIGHEST for action port [ 752.524322] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_rules [ 752.524322] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 752.524322] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e697b372-01a8-43de-85a2-fb89e9e0345f with Priority: HIGHEST for action port [ 752.525114] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.525276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.525339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.525556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.525641] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.526685] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.528523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.528523] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e697b372-01a8-43de-85a2-fb89e9e0345f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.528523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.528523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.528523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.528523] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e697b372-01a8-43de-85a2-fb89e9e0345f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.907543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.907543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.907543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.907543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.907543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.907543] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be updated. [ 752.940031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.940221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.940312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.941075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.941075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.952430] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 753.030777] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.030777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.031076] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e697b372-01a8-43de-85a2-fb89e9e0345f with status ACTIVE [ 753.031218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.031349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.031424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.031691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.031851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.032071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.032185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.032247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.032447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.032531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.034328] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.034328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.034328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.034328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.034328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.034328] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e697b372-01a8-43de-85a2-fb89e9e0345f is going to be updated. [ 753.071900] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.072185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.072496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.073449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.073449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.073449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e697b372-01a8-43de-85a2-fb89e9e0345f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.284693] env[65511]: INFO networking_nsxv3.common.synchronization [req-9de6e6ff-3534-4704-89d5-c915f0e7ae7b req-86151897-b3fa-4101-b839-b2541b78b6c9 tempest-FloatingIPsAssociationTestJSON-861519946 tempest-FloatingIPsAssociationTestJSON-861519946-project-member] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 753.285346] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGHEST for action security_group_members [ 753.285682] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.285806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.285873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.286194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.286372] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.286489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.286554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.286723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.286811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.286922] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.362772] env[65511]: INFO networking_nsxv3.common.synchronization [req-18f28da7-7e22-4a97-85fb-bc3c61ac3b98 req-9628b766-3da1-4764-a0e6-4fb8ec4eb313 tempest-VolumesAssistedSnapshotsTest-1228276739 tempest-VolumesAssistedSnapshotsTest-1228276739-project-member] Enqueued Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 753.363498] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a9691-2826-4bf1-8977-6d7594c8df89 with Priority: HIGHEST for action security_group_members [ 753.363824] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-897a9691-2826-4bf1-8977-6d7594c8df89 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.363948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.364056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.364337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.364435] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.364577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.364624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.364963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.364963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.364963] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('897a9691-2826-4bf1-8977-6d7594c8df89',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.790998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.791861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.792017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.792363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.792512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.792748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.792858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.792918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.793146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.793227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.793321] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be updated. [ 753.832758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.832758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.832758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.832758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.832758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.841081] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: IN_PROGRESS for 2s [ 753.872374] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.872374] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.872374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.872766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.872766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.872766] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 is going to be updated. [ 753.884481] env[65511]: INFO networking_nsxv3.common.synchronization [req-332a4586-ca34-44ae-8172-92430d58e5c5 req-d42910cb-029b-4a2a-a634-785836d16b69 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 753.885167] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 753.885494] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.885628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.885694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.885914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.886412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.886525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.886586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.886756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.887127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.887127] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.908168] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.909140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.909140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.909272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.909437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.921619] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: IN_PROGRESS for 2s [ 754.130645] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 754.130902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 4s [ 754.301685] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.302103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.302182] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.302490] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.303206] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.307146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.307146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.307146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.307146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.307146] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.307146] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.307146] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.307146] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.307146] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.307146] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.307146] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.334697] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.335060] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.335729] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.335729] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.335729] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-bdf5a8b4-dd14-4859-ac42-30bb3e751936 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.335729] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.336186] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.336348] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.336481] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf5a8b4-dd14-4859-ac42-30bb3e751936',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.390710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.391038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.391038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.391370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.391513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.392038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.392174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.392212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.392401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.392487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.392580] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 754.429335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.429542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.429636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.429912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.430132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.443097] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 754.840933] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.841329] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.841464] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.841754] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.841903] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.842070] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port bdf5a8b4-dd14-4859-ac42-30bb3e751936 not found, creating... [ 754.842592] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.842718] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.843586] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.843586] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.843586] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.843586] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.843746] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.843776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.843970] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.844166] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.844309] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: bdf5a8b4-dd14-4859-ac42-30bb3e751936 is going to be created. [ 754.868573] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.868855] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.869016] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.869449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.869856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.869856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.967632] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.967632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.967632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.967632] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.470137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.470337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.470648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.470912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.471123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.471243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.471296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.471456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.474040] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.474040] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.474040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.474040] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.679227] env[65511]: INFO networking_nsxv3.common.synchronization [req-332a4586-ca34-44ae-8172-92430d58e5c5 req-8d1092d6-31aa-4ec4-b949-00e815255f0a service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 755.682263] env[65511]: INFO networking_nsxv3.common.synchronization [req-332a4586-ca34-44ae-8172-92430d58e5c5 req-8d1092d6-31aa-4ec4-b949-00e815255f0a service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 755.682263] env[65511]: INFO networking_nsxv3.common.synchronization [req-332a4586-ca34-44ae-8172-92430d58e5c5 req-8d1092d6-31aa-4ec4-b949-00e815255f0a service nova] Enqueued Resource ID: bdf5a8b4-dd14-4859-ac42-30bb3e751936 with Priority: HIGHEST for action port [ 755.682263] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 755.682263] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 755.682263] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf5a8b4-dd14-4859-ac42-30bb3e751936 with Priority: HIGHEST for action port [ 755.682864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.683138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.683259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.683539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.683697] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.686250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.686250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.687313] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf5a8b4-dd14-4859-ac42-30bb3e751936 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.687313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.687313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.687313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.687313] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf5a8b4-dd14-4859-ac42-30bb3e751936',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.856618] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 264b2244-7780-4186-84f6-37be29843260 in Status: SUCCESS [ 755.857184] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 264b2244-7780-4186-84f6-37be29843260 deletion is rescheduled due to dependency. [ 755.857384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.932186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 897a9691-2826-4bf1-8977-6d7594c8df89 in Status: SUCCESS [ 755.932984] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 897a9691-2826-4bf1-8977-6d7594c8df89 deletion is rescheduled due to dependency. [ 755.932984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-897a9691-2826-4bf1-8977-6d7594c8df89" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.978599] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 232b7b09-b30d-4f2e-95a8-0315ce8667b1: rpc.has_security_group_logging(os_id): False [ 756.004753] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.004753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.004753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.005079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.005079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.005300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.005454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.005562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.005793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.005923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.006675] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.006835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.006908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.007132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.007573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.007573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.007573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.007793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.007793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.007890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.007966] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be updated. [ 756.075172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.075389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.075460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.075630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.075780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.087141] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 756.190876] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.190876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.190876] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdf5a8b4-dd14-4859-ac42-30bb3e751936 with status ACTIVE [ 756.190876] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.191144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.191144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.191399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.191530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.193148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.193148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.193148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.193673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.193673] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdf5a8b4-dd14-4859-ac42-30bb3e751936 is going to be updated. [ 756.218120] env[65511]: INFO networking_nsxv3.common.synchronization [req-aef1a434-292e-4d1b-addf-38a0e78f86a0 req-99177b10-6a07-4ece-8803-056dc0db7b89 tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 756.219362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.219620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.219732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.219950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.220133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.220352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf5a8b4-dd14-4859-ac42-30bb3e751936" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.221034] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 756.221262] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.221407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.221491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.221692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.223460] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.223460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.223460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.223460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.223460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.223460] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.242754] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 756.242979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.243471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.243704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.243971] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.244107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.244147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.244399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.244399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.244498] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.457192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 756.457397] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 756.457537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.457751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.458043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.458268] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.458409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.458474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.458693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.458782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.458900] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.703315] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.703570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.703710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.704082] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.704420] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.704647] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.704844] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.705101] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.705328] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.705627] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.705775] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.705952] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.706108] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.706279] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.706431] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.706572] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.725855] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.726138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.726236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.726474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.726581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.726790] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.726897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.726969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.727154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.727244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.727376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 756.729275] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.729459] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.729619] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.729843] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-338" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.730195] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.730394] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.730567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.730896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.731084] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.746592] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.764313] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.764541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.764541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.764751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.764887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.775490] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 756.963950] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.237281] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.237667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.237667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.237880] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.238038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.238239] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 not found, creating... [ 757.238440] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.238587] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.238691] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.238910] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.239131] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.239446] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.239664] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.239716] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.239894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.240026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.240161] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 is going to be created. [ 757.248886] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.262070] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.262274] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.262391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.262656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.262901] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.263164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.467132] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.753419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.753419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.753419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.753712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.753712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.753806] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 757.788744] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.788890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.788968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.789205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.789367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.801290] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 757.974481] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.974481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.974481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.974708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.974708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.974840] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 758.012988] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.013544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.013544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.013626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.013780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.026968] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 758.079268] env[65511]: INFO networking_nsxv3.common.synchronization [req-aef1a434-292e-4d1b-addf-38a0e78f86a0 req-b5a7283c-b1a7-4b43-b13d-42fbca28e6b4 service nova] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 758.079520] env[65511]: INFO networking_nsxv3.common.synchronization [req-aef1a434-292e-4d1b-addf-38a0e78f86a0 req-b5a7283c-b1a7-4b43-b13d-42fbca28e6b4 service nova] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 758.079651] env[65511]: INFO networking_nsxv3.common.synchronization [req-aef1a434-292e-4d1b-addf-38a0e78f86a0 req-b5a7283c-b1a7-4b43-b13d-42fbca28e6b4 service nova] Enqueued Resource ID: eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 with Priority: HIGHEST for action port [ 758.080244] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_rules [ 758.080372] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 758.080542] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 with Priority: HIGHEST for action port [ 758.080817] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.080927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.080988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.081222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.081302] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.082237] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.082443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.083029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.083198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.083198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.083371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.083446] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.100541] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 758.100648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.587077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.587371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.587425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 with status ACTIVE [ 758.589533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.589533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.589533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.589533] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0 is going to be updated. [ 758.617519] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.617726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.617827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.618112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.618294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.618498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb0b8dd4-20b4-4b7f-b04a-3eb02f9832d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.795453] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 758.795646] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 deletion is rescheduled due to dependency. [ 758.795765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.796172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.796220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.796422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.796549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.796615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.796776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.796861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.796962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.301967] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.804257] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.817153] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 759.817153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.817491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.818937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.821266] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.821266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.821266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.821266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.821266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.821266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.821266] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.036943] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 760.037446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.039329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.039329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.039329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.039329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.039329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.039780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.039945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.040114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.040267] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.307907] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.308138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.308312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.308546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.308700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.308898] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 760.328733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.328969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.329066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.329299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.329497] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.329605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.329670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.329839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.329932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.330031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.330318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.330318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.330457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.330520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.330646] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.330723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.330834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.330932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.331121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.331408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.331408] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.343941] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.344149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.344209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.344487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.344718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.356139] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 760.543510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.543773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.543773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.544106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.544188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.544855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.544855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.544855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.544855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.544855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.545133] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545462] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.545901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.546197] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.833520] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adb88e63-b602-4823-96eb-a58a3e31f8a1: rpc.has_security_group_logging(os_id): False [ 760.854317] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.854502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.854705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.854801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.854904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.855143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.855292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.855444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.855533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.855650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.855834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.856125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.856125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.856261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.856388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.857278] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.857392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.857458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.857616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.857696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.857785] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 760.937364] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.937927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.937927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.937927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.938077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.954119] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 761.049892] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 761.080599] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.080783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.080825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.081086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.081146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.081359] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.081482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.081548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.081742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.081828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.082081] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.082219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.082287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.082459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.082547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.082742] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.082837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.082968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.083489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.083489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.083489] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 761.186411] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.186775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.186775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.186894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.187073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.203829] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 762.371098] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 762.371098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.371098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.371098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.371484] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.371538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.371569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.371798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.371879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.372066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.372186] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.875108] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.971141] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 762.971489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.081635] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 763.081765] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 763.219056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 763.219309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.377574] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502: rpc.has_security_group_logging(os_id): False [ 763.411914] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.412164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.412312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.412709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.412982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.414034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.414507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.414679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.415311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.415483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.415646] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 763.515716] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.515914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.516566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.516566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.516566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.533796] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 764.666861] env[65511]: INFO networking_nsxv3.common.synchronization [req-c7e06e93-55f2-481a-8815-eb70860a7e08 req-2d808b68-8966-4568-a61a-b11e9107a969 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 764.667790] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 764.668120] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.668302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.668430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.668806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.669120] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.672099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.672099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.672099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.672099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.672099] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.175678] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.177184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.177184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.177184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.177184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.179031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.179031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.179031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.179233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.179384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.179532] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 765.219366] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.219366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.219366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.219366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.219366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.231989] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 765.561380] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 765.563856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.051166] env[65511]: INFO networking_nsxv3.common.synchronization [req-f173ac25-7ef1-4d74-8a9b-446afd07fd8a req-6c83897b-6f69-4456-8ed4-19059463fb55 tempest-ServerMetadataNegativeTestJSON-1001361171 tempest-ServerMetadataNegativeTestJSON-1001361171-project-member] Enqueued Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 766.051166] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 with Priority: HIGHEST for action security_group_members [ 766.051166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-964f8cb2-18ad-4766-ae61-bda439ab5514 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.051166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.052207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.052463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.053194] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.053720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.053944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.054282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.054403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.054556] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('964f8cb2-18ad-4766-ae61-bda439ab5514',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.149673] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc811b06-d1ad-43d7-b3af-3182303d0147 req-24221f5b-a101-4f1c-b9ad-8876b6cf80f1 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 766.150362] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 766.150722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.150844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.150963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.151286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.151550] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.151767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.151872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.152095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.152210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.152329] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.557491] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.557698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.557776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.557974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.558089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.558379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.558480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.558480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.558636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.558724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.559149] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 is going to be updated. [ 766.593766] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.594064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.594559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.594559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.594653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.606055] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: IN_PROGRESS for 2s [ 766.621968] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.622168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.622304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.622560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.622806] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.623341] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.623502] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.623728] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.623936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.624193] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.624338] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.624451] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.624681] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.624795] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.625198] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.625198] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.650352] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.650691] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.652606] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.652606] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.652606] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-bf1132c5-2027-4fec-bea9-25adc5551eae taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.652606] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.652606] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.652940] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.653140] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1132c5-2027-4fec-bea9-25adc5551eae',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.654817] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.655061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.656452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.656812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.656996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.657355] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.657576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.657694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.658355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.658570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.658758] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 766.694810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.694996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.695140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.696158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.696158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.708261] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 767.161541] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.161987] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.162076] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.162456] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.162745] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.162971] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port bf1132c5-2027-4fec-bea9-25adc5551eae not found, creating... [ 767.163488] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.163763] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.164021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.164357] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.164567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.165024] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.165297] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.165468] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.165787] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.165988] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.166226] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: bf1132c5-2027-4fec-bea9-25adc5551eae is going to be created. [ 767.192806] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.193104] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.193207] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.193815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.193815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.194186] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.242740] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 767.242954] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 deletion is rescheduled due to dependency. [ 767.243071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.959994] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc811b06-d1ad-43d7-b3af-3182303d0147 req-87db0c27-4ff1-4654-8403-11d7acf3cc99 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 767.959994] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc811b06-d1ad-43d7-b3af-3182303d0147 req-87db0c27-4ff1-4654-8403-11d7acf3cc99 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 767.959994] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc811b06-d1ad-43d7-b3af-3182303d0147 req-87db0c27-4ff1-4654-8403-11d7acf3cc99 service nova] Enqueued Resource ID: bf1132c5-2027-4fec-bea9-25adc5551eae with Priority: HIGHEST for action port [ 767.960291] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 767.960354] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 767.960451] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1132c5-2027-4fec-bea9-25adc5551eae with Priority: HIGHEST for action port [ 767.960797] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.960909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.960998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.961251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.961440] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.962694] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.964197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.964539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1132c5-2027-4fec-bea9-25adc5551eae taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.964724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.964840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.965239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.965361] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1132c5-2027-4fec-bea9-25adc5551eae',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.467282] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.467725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.467725] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf1132c5-2027-4fec-bea9-25adc5551eae with status ACTIVE [ 768.467913] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.468026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.468092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.468335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.468452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.468637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.468760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.468824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.469038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.469130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.469696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.470205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.470205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.470205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.470205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.470434] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf1132c5-2027-4fec-bea9-25adc5551eae is going to be updated. [ 768.506058] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.506267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.506377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.506613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.506950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.507170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1132c5-2027-4fec-bea9-25adc5551eae" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.625504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 in Status: SUCCESS [ 768.626287] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 964f8cb2-18ad-4766-ae61-bda439ab5514 deletion is rescheduled due to dependency. [ 768.626287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-964f8cb2-18ad-4766-ae61-bda439ab5514" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.720478] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 768.720780] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 deletion is rescheduled due to dependency. [ 768.720977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.721365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.721883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.722241] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.722369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.722479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.723095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.723253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.723863] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.226629] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.729428] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.232822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.233104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.233179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.233465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.233635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.233791] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 770.264821] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.265094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.265094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.265289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.265456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.278392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 770.695900] env[65511]: INFO networking_nsxv3.common.synchronization [req-711d7e8e-d4fb-4a9a-a36c-edf3fc62f431 req-3d4c3a22-44e9-4d98-a364-1767c50d322d tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 770.699909] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e with Priority: HIGHEST for action security_group_members [ 770.700874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.701157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.701284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.701658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.701954] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.702074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.702219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.702512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.702697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.702802] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48fd9074-e82c-4b2f-86bc-96c1badeaa2e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.206847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.207269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.207269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.207448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.207448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.207589] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.207690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.207772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.207931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.208018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.208109] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e is going to be updated. [ 771.244591] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.244835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.244976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.245344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.245619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.256745] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: IN_PROGRESS for 2s [ 771.599861] env[65511]: INFO networking_nsxv3.common.synchronization [req-1c6877bc-f9da-4e50-9285-d68c4f34e385 req-01f875cb-cd40-440d-840b-41b27e57fb94 tempest-ServersTestFqdnHostnames-9397888 tempest-ServersTestFqdnHostnames-9397888-project-member] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 771.601113] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 771.601766] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.602025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.602025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.602444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.602642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.602775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.602858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.603025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.603161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.603307] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.018342] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.019045] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-39" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.019045] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-39" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.019270] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-39" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.019467] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.019726] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.019896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.020168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.020375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.020698] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.020929] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.021030] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.021188] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.021307] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.021409] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.021597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.048963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.048963] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.049200] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.049200] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-39" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.049531] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-68eb6d6c-715c-411e-a5b4-a1f88561b29f taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.050107] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.050107] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.050370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.050508] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68eb6d6c-715c-411e-a5b4-a1f88561b29f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.109113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.109113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.109113] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 already deleted. [ 772.109113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.294829] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 772.295246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.295448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.295734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.296052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.296320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.296420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.296585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.296709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.296808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.296929] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.552920] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.553310] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.553514] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.554073] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.554212] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.554458] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 68eb6d6c-715c-411e-a5b4-a1f88561b29f not found, creating... [ 772.554866] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.555127] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.555308] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.555636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.555855] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.556355] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.556594] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.556777] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557114] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557328] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.557547] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 68eb6d6c-715c-411e-a5b4-a1f88561b29f is going to be created. [ 772.579880] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.580321] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.580469] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.580759] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.580998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.581320] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.800083] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.800338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.800338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.800587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.800743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.800886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.800957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.801258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.801645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.801708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.801858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.802016] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.802127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.802196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.802345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.802445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.802630] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.266739] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e in Status: SUCCESS [ 773.266922] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48fd9074-e82c-4b2f-86bc-96c1badeaa2e deletion is rescheduled due to dependency. [ 773.267173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48fd9074-e82c-4b2f-86bc-96c1badeaa2e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.307640] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49eab9c1-0cf4-4ab1-83f1-830592c0f740: rpc.has_security_group_logging(os_id): False [ 773.327957] env[65511]: INFO networking_nsxv3.common.synchronization [req-1c6877bc-f9da-4e50-9285-d68c4f34e385 req-4908f9e5-c887-4fc8-a49c-72c4605f2196 service nova] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 773.328160] env[65511]: INFO networking_nsxv3.common.synchronization [req-1c6877bc-f9da-4e50-9285-d68c4f34e385 req-4908f9e5-c887-4fc8-a49c-72c4605f2196 service nova] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 773.328291] env[65511]: INFO networking_nsxv3.common.synchronization [req-1c6877bc-f9da-4e50-9285-d68c4f34e385 req-4908f9e5-c887-4fc8-a49c-72c4605f2196 service nova] Enqueued Resource ID: 68eb6d6c-715c-411e-a5b4-a1f88561b29f with Priority: HIGHEST for action port [ 773.329796] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.331249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.331341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.331550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.331659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.331864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.331991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.332826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.332826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.332826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.332935] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.333064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.333064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.333225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.333307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.333501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.333598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.333660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.333918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.333918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.333972] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 773.335685] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_rules [ 773.335685] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 773.335685] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68eb6d6c-715c-411e-a5b4-a1f88561b29f with Priority: HIGHEST for action port [ 773.336228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.336336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.336400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.336575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.336642] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.337887] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.337996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.338228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.338368] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.338464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.338980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.339117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.339409] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.340022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-68eb6d6c-715c-411e-a5b4-a1f88561b29f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.340161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.340230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.340383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.340476] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68eb6d6c-715c-411e-a5b4-a1f88561b29f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.441021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.441257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.441332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.441691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.441691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.464305] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 773.843376] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.843879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68eb6d6c-715c-411e-a5b4-a1f88561b29f with status ACTIVE [ 773.844134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.844286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.844338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.844688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.844688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.844814] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.844862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.844908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.846135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.846135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.846135] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68eb6d6c-715c-411e-a5b4-a1f88561b29f is going to be updated. [ 773.846887] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.847042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.867642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.867849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.867849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.868190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.868355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.868518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68eb6d6c-715c-411e-a5b4-a1f88561b29f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.348767] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.539977] env[65511]: INFO networking_nsxv3.common.synchronization [req-53e2d4d9-a20e-4126-960b-314648f3d0e6 req-18478903-d648-44cd-87d9-0c4b0f76c01b tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 774.540811] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 774.541291] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.542858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.542858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.542858] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.851718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.851901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.851989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.852650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.852769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.852873] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 is going to be created. [ 774.877259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.877502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.877553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.877737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.877921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.890202] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: UNINITIALIZED for 2s [ 775.044284] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.044481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.044544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.044725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.044816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.045020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.045395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.045813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.045813] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a already deleted. [ 775.045813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.076080] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.076339] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.076508] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.076870] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.077174] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.077344] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.077458] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.077718] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.077867] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.078123] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.078262] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.078373] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.078476] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.078587] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.078686] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.078833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.098560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.098723] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.098856] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.099044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.099382] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.099611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.099772] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.100129] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.100267] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae2275a-765e-4ecf-91ab-a9b5af153bf6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.477711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 775.478174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.603297] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.603521] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.603641] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.603942] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.604129] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.604377] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 not found, creating... [ 775.604582] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.604733] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.604858] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.605160] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.605267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.605576] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.605724] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.605833] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.606049] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.606196] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.606332] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 is going to be created. [ 775.628728] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.628931] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.629059] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.629332] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.629551] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.629769] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.467168] env[65511]: INFO networking_nsxv3.common.synchronization [req-53e2d4d9-a20e-4126-960b-314648f3d0e6 req-061b61ab-710c-48a0-8f44-c042adaad555 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 776.468026] env[65511]: INFO networking_nsxv3.common.synchronization [req-53e2d4d9-a20e-4126-960b-314648f3d0e6 req-061b61ab-710c-48a0-8f44-c042adaad555 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 776.468026] env[65511]: INFO networking_nsxv3.common.synchronization [req-53e2d4d9-a20e-4126-960b-314648f3d0e6 req-061b61ab-710c-48a0-8f44-c042adaad555 service nova] Enqueued Resource ID: 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 with Priority: HIGHEST for action port [ 776.468370] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 776.468523] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 776.468621] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 with Priority: HIGHEST for action port [ 776.468995] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.469115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.469262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.469588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.470221] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.473276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.473276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.473276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.473916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.474399] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.475621] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.475621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.475621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.475621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.475784] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae2275a-765e-4ecf-91ab-a9b5af153bf6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.900514] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: SUCCESS [ 776.900893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.900893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.901139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.901336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.901508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.901508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.901664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.901742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.901828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.901919] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.977357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.979064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.979064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.979333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 with status ACTIVE [ 776.979557] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.979738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.979864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.981395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.981558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.981884] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.982071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.982172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.982468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.982590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.982911] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.983186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.983351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.983477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.983601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.983735] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ae2275a-765e-4ecf-91ab-a9b5af153bf6 is going to be updated. [ 777.009823] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.010058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.010058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.010222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.010376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.010535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae2275a-765e-4ecf-91ab-a9b5af153bf6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.404529] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.487461] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.907815] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee64cf57-98ae-44f7-84e3-20cf3c5c2489: rpc.has_security_group_logging(os_id): False [ 777.926254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.926484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.926570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.926821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.926940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.927222] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.927325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.927389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.927573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.927642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.927733] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 is going to be created. [ 777.992183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.992382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.992434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.994364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.994364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.994364] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be created. [ 777.994953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.995097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.995252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.995408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.995804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.007964] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: IN_PROGRESS for 2s [ 778.028097] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.028097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.028097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.028097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.028097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.051441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: UNINITIALIZED for 2s [ 780.024400] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: SUCCESS [ 780.024400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.063226] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 780.063226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.063226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.063431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.063594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.063712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.065184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.065184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.065184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.065184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.065184] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.567461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.567762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.567867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.568143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.568897] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.568897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.568897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.569067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.569250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.569439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.569648] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.569777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.569813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.569984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.570137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.570229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.570288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.570429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.570511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.570592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.571066] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.074406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 781.094897] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.096732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.096732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.096732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.097206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.097695] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.098047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.099036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.099036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.099036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.099036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.099437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.099607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.099879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.100619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.102985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.102985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.102985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.102985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.102985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.102985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be created. [ 781.175618] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.175618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.175618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.175618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.175618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.186922] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 781.471589] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 781.471589] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 781.966688] env[65511]: INFO networking_nsxv3.common.synchronization [req-e651c538-8c7e-4e55-8cf5-a86b5352ce1f req-08f9b284-693d-4e2b-94c0-0263db42ea55 tempest-ServersAdminNegativeTestJSON-511239178 tempest-ServersAdminNegativeTestJSON-511239178-project-member] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 781.967248] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 781.967611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.969021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.969021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.969021] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.472123] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.974722] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.027781] env[65511]: INFO networking_nsxv3.common.synchronization [req-e9e7729e-57f8-4321-b8dc-940ddd338f29 req-e2175b0b-280c-462b-b0a0-c15498298307 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 783.028439] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 783.028757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.029420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.029420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.029420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.029653] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.029859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.029950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.030471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.030471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.030471] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.202623] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 783.203201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.479388] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.479388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.479388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.479388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.479388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.479388] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be updated. [ 783.533151] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.536822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.537433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.537704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.538108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.539082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.549650] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 783.561028] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.561028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.561028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.561028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.561481] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.561831] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.562194] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.562599] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.562919] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.564565] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.564565] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.564565] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.564565] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.564565] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.564565] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.564565] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.593666] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.593666] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.593666] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.593666] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-821" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.593909] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.594035] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.594151] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.594499] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.594654] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.036579] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.098948] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.099370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.099479] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.099897] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.100197] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.100614] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a not found, creating... [ 784.100965] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.100965] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.101144] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.101555] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.101555] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.101809] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.102018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.102282] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.102484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.102650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.102794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a is going to be created. [ 784.124870] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.125113] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.125408] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.125758] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.126055] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.126413] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.539420] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.539677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.539677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.539921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.540322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.540322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 784.574458] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.574669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.574669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.575765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.575765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.585877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [req-e9e7729e-57f8-4321-b8dc-940ddd338f29 req-77e9fa5c-279e-47d5-b0eb-bffd318f8891 service nova] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [req-e9e7729e-57f8-4321-b8dc-940ddd338f29 req-77e9fa5c-279e-47d5-b0eb-bffd318f8891 service nova] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [req-e9e7729e-57f8-4321-b8dc-940ddd338f29 req-77e9fa5c-279e-47d5-b0eb-bffd318f8891 service nova] Enqueued Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 784.874862] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 784.874862] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.874862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.874862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.874862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.874862] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.876152] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.876452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.876783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.877120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.878033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.878033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.878033] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.381245] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with status ACTIVE [ 785.381245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.381449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.381449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.381668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.381753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.381932] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.382038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.382112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.382281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.382368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.382580] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.382683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.382741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.382859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.382932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.383028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a is going to be updated. [ 785.384711] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.384711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.407337] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.407599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.407599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.407782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.407919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.408094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.562647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 785.562997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.654512] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5ffadf35-39b9-49cf-be38-2a7fbc23dfe4 None None] Enqueued Resource ID: 8390811a-5022-44ae-99b0-42cc26bdae6b with Priority: HIGHEST for action port [ 785.655143] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8390811a-5022-44ae-99b0-42cc26bdae6b with Priority: HIGHEST for action port [ 785.655501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8390811a-5022-44ae-99b0-42cc26bdae6b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.656018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8390811a-5022-44ae-99b0-42cc26bdae6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.656284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8390811a-5022-44ae-99b0-42cc26bdae6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.657043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8390811a-5022-44ae-99b0-42cc26bdae6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.657043] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8390811a-5022-44ae-99b0-42cc26bdae6b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.159937] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8390811a-5022-44ae-99b0-42cc26bdae6b [ 786.160323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.160525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.160814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.160976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.161090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.161208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8390811a-5022-44ae-99b0-42cc26bdae6b already deleted. [ 786.161317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8390811a-5022-44ae-99b0-42cc26bdae6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.598479] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.598479] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.598479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.598479] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.993409] env[65511]: INFO networking_nsxv3.common.synchronization [req-a3e14df0-ff24-499f-86d5-2f7962c1ce55 req-75585b76-82b7-4b2e-8eed-b4d08036c7cd tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 786.993409] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 786.993409] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.993409] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.993409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.993409] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.100359] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.495775] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.495951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.496033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.496276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.496408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.496609] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.496758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.496874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.497022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.497104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.497163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 787.532239] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.532393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.533221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.533707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.534390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.546385] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 787.603708] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.646432] env[65511]: INFO networking_nsxv3.common.synchronization [None req-7036eeec-877c-4d40-9d08-1978ff46b676 None None] Enqueued Resource ID: 5e75bedd-3d74-422b-ab8a-66df2fc0d069 with Priority: HIGHEST for action port [ 787.649274] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e75bedd-3d74-422b-ab8a-66df2fc0d069 with Priority: HIGHEST for action port [ 787.650236] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e75bedd-3d74-422b-ab8a-66df2fc0d069 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.650608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e75bedd-3d74-422b-ab8a-66df2fc0d069" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.651259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e75bedd-3d74-422b-ab8a-66df2fc0d069" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.651560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e75bedd-3d74-422b-ab8a-66df2fc0d069" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.651783] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e75bedd-3d74-422b-ab8a-66df2fc0d069',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.040564] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0356ccf4-7dfa-492c-a483-a2e195874df8 None None] Enqueued Resource ID: 20aa36fe-cf70-43d2-9609-2c62d6b49b52 with Priority: HIGHEST for action port [ 788.041179] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20aa36fe-cf70-43d2-9609-2c62d6b49b52 with Priority: HIGHEST for action port [ 788.041546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-20aa36fe-cf70-43d2-9609-2c62d6b49b52 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.041675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20aa36fe-cf70-43d2-9609-2c62d6b49b52" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.041742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20aa36fe-cf70-43d2-9609-2c62d6b49b52" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.043619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20aa36fe-cf70-43d2-9609-2c62d6b49b52" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.043801] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20aa36fe-cf70-43d2-9609-2c62d6b49b52',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.107939] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.107939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.107939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.107939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.107939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.109038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 788.149700] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.149885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.149930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.150171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.150488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.155452] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e75bedd-3d74-422b-ab8a-66df2fc0d069 [ 788.157038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.157038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.157038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.157038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.157038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.157038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e75bedd-3d74-422b-ab8a-66df2fc0d069 already deleted. [ 788.157038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e75bedd-3d74-422b-ab8a-66df2fc0d069" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.161746] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 788.546120] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20aa36fe-cf70-43d2-9609-2c62d6b49b52 [ 788.548938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.548938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.548938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.548938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.548938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.548938] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20aa36fe-cf70-43d2-9609-2c62d6b49b52 already deleted. [ 788.548938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20aa36fe-cf70-43d2-9609-2c62d6b49b52" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.021591] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0e24e04a-37dd-40fc-b454-d9e387998b18 None None] Enqueued Resource ID: 3ba90a1c-ec7e-4643-a50c-8abe9b216eba with Priority: HIGHEST for action port [ 789.021861] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ba90a1c-ec7e-4643-a50c-8abe9b216eba with Priority: HIGHEST for action port [ 789.023642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ba90a1c-ec7e-4643-a50c-8abe9b216eba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.023642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ba90a1c-ec7e-4643-a50c-8abe9b216eba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.023642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ba90a1c-ec7e-4643-a50c-8abe9b216eba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.023642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ba90a1c-ec7e-4643-a50c-8abe9b216eba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.023642] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ba90a1c-ec7e-4643-a50c-8abe9b216eba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.526970] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ba90a1c-ec7e-4643-a50c-8abe9b216eba [ 789.527262] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.528882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.528882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.528882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.528882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.528882] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ba90a1c-ec7e-4643-a50c-8abe9b216eba already deleted. [ 789.528882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ba90a1c-ec7e-4643-a50c-8abe9b216eba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.556459] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 789.556653] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 789.556763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.140519] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:0 completed [ 790.140519] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:1 started [ 790.173367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 790.173647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.173918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.174291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.175413] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.175413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.175413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.175413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.175413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.175413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.175749] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.532436] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c084ef59-cd32-438e-a8f8-cad7eeb19cd0 None None] Enqueued Resource ID: 7f2561c7-adbd-4360-8bec-172b0f1150af with Priority: HIGHEST for action port [ 790.532703] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f2561c7-adbd-4360-8bec-172b0f1150af with Priority: HIGHEST for action port [ 790.533326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f2561c7-adbd-4360-8bec-172b0f1150af taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.533452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f2561c7-adbd-4360-8bec-172b0f1150af" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.533496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f2561c7-adbd-4360-8bec-172b0f1150af" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.533826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f2561c7-adbd-4360-8bec-172b0f1150af" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.533952] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f2561c7-adbd-4360-8bec-172b0f1150af',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.682028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.682028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.682028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.682028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.682028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.683040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.683040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.683040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.683040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.683040] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.036729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f2561c7-adbd-4360-8bec-172b0f1150af [ 791.037027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.037191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.037252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.037536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.037687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.037870] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f2561c7-adbd-4360-8bec-172b0f1150af already deleted. [ 791.037932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f2561c7-adbd-4360-8bec-172b0f1150af" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.187163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 791.206858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.206858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.207110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.207213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.207259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.207494] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.207596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.207657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.208837] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.208837] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.208837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.209303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.209303] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 791.280507] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.280989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.282911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.282911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.282911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.297635] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 792.196513] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0618561b-7373-429e-832d-2d4924545298 None None] Enqueued Resource ID: 4cf8e1b8-df7f-4496-814c-cb05fa005daf with Priority: HIGHEST for action port [ 792.197063] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf8e1b8-df7f-4496-814c-cb05fa005daf with Priority: HIGHEST for action port [ 792.197668] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf8e1b8-df7f-4496-814c-cb05fa005daf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.197668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf8e1b8-df7f-4496-814c-cb05fa005daf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.197668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf8e1b8-df7f-4496-814c-cb05fa005daf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.197992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf8e1b8-df7f-4496-814c-cb05fa005daf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.198956] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf8e1b8-df7f-4496-814c-cb05fa005daf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.430901] env[65511]: INFO networking_nsxv3.common.synchronization [None req-63619288-befd-45d4-8274-0ba46bdc949d tempest-ServersTestBootFromVolume-1594891053 tempest-ServersTestBootFromVolume-1594891053-project-member] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 792.431823] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 792.431823] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.431923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.431992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.432529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.432623] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.544164] env[65511]: INFO networking_nsxv3.common.synchronization [None req-dd50755b-aac0-45ab-a19e-2ce1fbfc06bc tempest-ServersTestBootFromVolume-1594891053 tempest-ServersTestBootFromVolume-1594891053-project-member] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 792.544164] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 792.544164] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.544164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.704411] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cf8e1b8-df7f-4496-814c-cb05fa005daf [ 792.704793] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.704917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.705022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.705314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.705485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.705669] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cf8e1b8-df7f-4496-814c-cb05fa005daf already deleted. [ 792.705899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf8e1b8-df7f-4496-814c-cb05fa005daf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.961885] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.961885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.961885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.961885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.961885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.961885] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d already deleted. [ 792.962334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.962334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.962334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.962334] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.319555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 793.319555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.491192] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.491192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.491192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.491192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.491192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.491192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d already deleted. [ 793.491192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.298744] env[65511]: INFO networking_nsxv3.common.synchronization [req-0efe6804-848e-4f70-b0b7-3bf6a10e998f req-4bea345a-0407-4680-9ee2-94dc74de457f tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 795.299674] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 795.300261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.300423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.300506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.300870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.301105] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.301236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.301318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.301588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.301757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.301917] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.805248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.805461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.806465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.806465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.806825] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c already deleted. [ 795.806825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.914833] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.915038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.915143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.915497] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.915782] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.916013] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.916239] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.916481] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.916625] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.916843] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.916945] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.917226] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.917226] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.917325] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.917325] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.918051] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.938767] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.938972] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 795.939095] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.939267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.939584] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.940247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.940247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.940247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.940356] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.442791] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.443250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.443250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.443409] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.443550] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.443704] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d not found, creating... [ 796.443948] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.444111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.444221] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.444434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.444564] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.444839] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.444982] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.445101] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.445338] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.445470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.445616] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d is going to be created. [ 796.471769] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.472036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.472117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.472457] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.472690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.472917] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.198888] env[65511]: INFO networking_nsxv3.common.synchronization [req-e9a01895-9804-47ad-bf03-56925f53fb7f req-d7809d53-926b-45d4-8c84-d1f679ad6be7 tempest-ServerRescueTestJSON-356650576 tempest-ServerRescueTestJSON-356650576-project-member] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 797.199123] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 797.199510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.199952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.199952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.199952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.200724] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.202027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.202027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202188] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.313912] env[65511]: INFO networking_nsxv3.common.synchronization [req-0efe6804-848e-4f70-b0b7-3bf6a10e998f req-345670ea-518f-48d0-bc35-a3239b130d84 service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 797.314072] env[65511]: INFO networking_nsxv3.common.synchronization [req-0efe6804-848e-4f70-b0b7-3bf6a10e998f req-345670ea-518f-48d0-bc35-a3239b130d84 service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 797.314208] env[65511]: INFO networking_nsxv3.common.synchronization [req-0efe6804-848e-4f70-b0b7-3bf6a10e998f req-345670ea-518f-48d0-bc35-a3239b130d84 service nova] Enqueued Resource ID: 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d with Priority: HIGHEST for action port [ 797.315310] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 797.315310] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 797.315310] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d with Priority: HIGHEST for action port [ 797.315894] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.315894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.315894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.316088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.316173] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.317909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.317909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.317909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.317909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.319753] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.319753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.319753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.319753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.319753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.319753] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.320849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.320849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.320849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.320849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.321394] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.708027] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.823119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.823256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.823544] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.828065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d with status ACTIVE [ 797.828298] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.828460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.828547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.828762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.828848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.829035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.829137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.829197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.829436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.829436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.829608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.829774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.829824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.829991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.830062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.830126] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d is going to be updated. [ 797.852537] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.852746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.852831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.853056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.853199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.853410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff64dfc-18e2-45ba-8aa6-4cd1ff1e386d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.209088] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.325882] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.712485] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.712485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.712485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.712485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.712485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.712485] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 798.757586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.757819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.757909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.758187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.758418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.770278] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 798.829414] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.830567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.830567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.830717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.830752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.831209] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be created. [ 798.878488] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.878488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.878488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.878488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.878488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.890056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: UNINITIALIZED for 2s [ 799.077482] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 799.077715] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 799.078400] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 799.078671] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 799.078936] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.079126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.079221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.079557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.079806] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.079972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.080097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.080316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.080458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.080618] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.081684] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.081865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.082018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.082758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.082758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.082758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.082758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.082758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.082962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.082962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.136371] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 799.136528] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 799.136821] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_rules [ 799.136821] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 799.136958] env[65511]: INFO networking_nsxv3.common.synchronization [req-f8d13661-da71-44d9-a2e7-4404936be288 req-77445d4c-0bff-4151-a3b1-b0e97713443d tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 799.137430] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 799.137562] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_rules [ 799.137728] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 799.140952] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 799.141149] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 799.142413] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.142573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.142649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.142861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.142948] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.144297] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.144297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.144297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.144514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.144514] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.145352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.145517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.145769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.145901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.146105] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.147302] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.147504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.148198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.148198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.585020] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.586135] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.609495] env[65511]: INFO networking_nsxv3.common.synchronization [req-c1f1831f-32c4-41cf-be13-987f667f914c req-9297cf2d-2887-401a-bfe5-e02091eabc6c tempest-ImagesOneServerTestJSON-1873038650 tempest-ImagesOneServerTestJSON-1873038650-project-member] Enqueued Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 799.610500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGHEST for action security_group_members [ 799.610870] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.611165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.611165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.611357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.611540] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.612115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.612191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.612366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.612456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.612554] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.652028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with status ACTIVE [ 799.652028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.652028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.652028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.652028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.652028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a is going to be updated. [ 799.658376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.658376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.658376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.658376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.685227] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.685426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.685505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.685700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.685846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.686017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.812819] env[65511]: INFO networking_nsxv3.common.synchronization [None req-27d0e59a-f634-4911-af32-93f1ff47550c tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 799.813429] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 799.813647] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.813770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.813831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.814248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.814335] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.933761] env[65511]: INFO networking_nsxv3.common.synchronization [None req-effee46e-ca0b-4dc5-8eee-ac906e9e26ea tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 799.935862] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 799.936233] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.936374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.087755] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.088944] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.115768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.116257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.116361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.116630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.116759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.117215] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.117357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.117422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.117592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.117664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.117752] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 is going to be updated. [ 800.153679] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.153850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.153892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.154569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.154569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.166972] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: IN_PROGRESS for 2s [ 800.337608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.337608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.337608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.337608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.337608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.337608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 already deleted. [ 800.337608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.337972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.337972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338039] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.590735] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.590989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.591120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.591381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.591536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.591668] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be created. [ 800.593227] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.593334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.593393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.593556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.593642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.593729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 800.624818] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.624959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.625061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.625263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.625495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.629148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.629284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.629354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.629536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.629714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.639082] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 800.639780] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: UNINITIALIZED for 2s [ 800.784048] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 800.784048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.863063] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.863405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.863548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.863869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.864058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.864641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 already deleted. [ 800.864641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.900376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 800.900632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.900809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.901064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.901271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.901412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.901480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.901653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.901734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.901822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.901925] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.406903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.406903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.406903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.406903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.406903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.407714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.407714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.407714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.407714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.407714] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.909617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c75da86d-70ea-4fc8-86a4-c249315ae94c: rpc.has_security_group_logging(os_id): False [ 801.930766] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.930955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.931088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.931206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.931309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.931496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.931603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.931642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.931799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.931879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.932270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.932270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.932270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.932552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.932552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.932642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.932720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.934940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.936661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.936661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.936661] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be created. [ 802.005632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.005830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.005870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.006165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.006468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.023060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 802.180098] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 in Status: SUCCESS [ 802.180294] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 deletion is rescheduled due to dependency. [ 802.180419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.652026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 802.652371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.652660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.652960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.653234] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.653532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.653660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.653907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.654082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.654247] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.656194] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 802.656506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.656751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.656916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.657123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.657237] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.657302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.657489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.657574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.658061] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.807556] env[65511]: INFO networking_nsxv3.common.synchronization [req-2ccf676c-fe84-48a4-86c7-d3ffcf9fdb0e req-997939fb-0246-4bbd-a38f-c3c50ffc4ad0 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 802.807990] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 802.808390] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.808482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.808544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.809231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.809231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.809231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.809231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.809540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.809540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.809540] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.160591] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.162282] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.311770] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.311924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.311924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.312170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.312256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.312462] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.312578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.312622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.312786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.312873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.313024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 803.343111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.343342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.343342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.343523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.343718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.354699] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 803.663831] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.667800] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.035764] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 804.036371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.168609] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.168948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.168948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.169693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.169693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.169693] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 804.171376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.171376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.171376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.171376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.171376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.171623] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be updated. [ 804.217733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.218224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.218563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.218926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.220172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.225149] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.225366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.225493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.225829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.227179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.243113] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 804.244043] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 805.367621] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 805.368111] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 deletion is rescheduled due to dependency. [ 805.368111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.766260] env[65511]: INFO networking_nsxv3.common.synchronization [req-ecf17edf-01b6-4563-863c-cd5dc50c67a3 req-0c748007-f390-40fb-8080-05c2545d4bd9 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 805.767025] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 805.767165] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.767287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.767287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.767436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.767600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.767698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.767734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.767912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.768641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.768641] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.258065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 806.258318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.258588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.258869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.259117] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.259249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.259322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.259494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.259580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.259720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.260492] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.261549] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 806.261754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.261964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.262207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.262468] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.262588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.262684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.262903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.263018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.263120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.263436] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.273318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.765835] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.767511] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.767659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.767756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.767999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.768170] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.768269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.768333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.768493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.768580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.768666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.768838] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.768976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.769081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.769236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.769373] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.769483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.769545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.769680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.769776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.769859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.769972] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.776231] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.272199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c553cc08-e219-4e38-a548-11dc094c8dd7: rpc.has_security_group_logging(os_id): False [ 807.275527] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 807.279471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.279626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.279692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.279913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.280015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.280120] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 807.294905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.295180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.295180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.295431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.295527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.295767] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.295863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.295930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.296143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.296215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.296399] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.296546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.296687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.296820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.296890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.297092] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.297178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.297244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.297423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.297511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.297604] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 807.299593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.299796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.299796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.299967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.300057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.300275] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.300393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.300494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.300653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.300726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.300810] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be created. [ 807.323214] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.323448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.323506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.323739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.323938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.334638] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 807.374792] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.375052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.375121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.375523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.375833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.381589] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.381827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.381827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.382146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.382404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.391907] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 807.401583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 807.417627] env[65511]: INFO networking_nsxv3.common.synchronization [req-52bc9d2c-fd38-41b7-a966-cb71d449d42e req-7dff17fa-55b1-451c-a65c-8b3186dc3571 tempest-ListImageFiltersTestJSON-1712442466 tempest-ListImageFiltersTestJSON-1712442466-project-member] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 807.419103] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 807.420952] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.420952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.420952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.420952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.421795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.421997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.422178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.422520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.422672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.422867] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.925600] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.043442] env[65511]: INFO networking_nsxv3.common.synchronization [req-ce15c123-e15e-46b4-a2fa-26752bd585a5 req-9e72f147-97a9-4cb9-b5dc-07906dfe3607 tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 808.045170] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 808.045170] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.045707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046084] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.046084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.046084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.046565] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.243895] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a714f5f3-2892-4495-aa93-587591c67720 None None] Enqueued Resource ID: 41047190-6868-44df-b2a3-2a4df8aa5138 with Priority: HIGHEST for action port [ 808.244539] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41047190-6868-44df-b2a3-2a4df8aa5138 with Priority: HIGHEST for action port [ 808.245052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-41047190-6868-44df-b2a3-2a4df8aa5138 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.245253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41047190-6868-44df-b2a3-2a4df8aa5138" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.245401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41047190-6868-44df-b2a3-2a4df8aa5138" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.246338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41047190-6868-44df-b2a3-2a4df8aa5138" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.246338] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41047190-6868-44df-b2a3-2a4df8aa5138',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.427932] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.492539] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.492672] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.492824] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.493022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.493287] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.493437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.493554] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.493810] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.493991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.494326] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.494437] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.494550] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.494651] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.494766] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.494873] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.494994] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.521753] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.522106] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.522106] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.522259] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.522593] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-79fdca1a-06c3-446c-9acb-f7212f37266b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.522792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.522902] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.523269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.523510] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fdca1a-06c3-446c-9acb-f7212f37266b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.550073] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.750839] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41047190-6868-44df-b2a3-2a4df8aa5138 [ 808.751123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.751259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.751332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.751557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.751652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.751748] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41047190-6868-44df-b2a3-2a4df8aa5138 already deleted. [ 808.751856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41047190-6868-44df-b2a3-2a4df8aa5138" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.934468] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.934873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.934873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.935098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.935264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.935455] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be updated. [ 808.971048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.971048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.971048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.971349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.971557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.984530] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 809.026072] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.026313] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.026495] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.026749] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.026891] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.027063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 79fdca1a-06c3-446c-9acb-f7212f37266b not found, creating... [ 809.027342] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.027504] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.027616] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.027865] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.028056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.028375] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.028531] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.028639] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.028871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.028994] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.029164] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 79fdca1a-06c3-446c-9acb-f7212f37266b is going to be created. [ 809.051862] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.052104] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.052233] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.052562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.052992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.053124] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.054027] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.348234] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 809.348511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.405367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 809.405785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.417657] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 809.418180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.508838] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 809.509120] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 809.509326] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 809.510223] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 809.511156] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 809.511156] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 809.511156] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.511380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.511380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.511725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.512018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.512235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.512321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.512524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.512683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.512837] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.513954] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc1dadc-11e9-4539-b83b-670064a2270d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.514129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.514256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.514564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.514759] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.515244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.515384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.516229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.517796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517796] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.518300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.518407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.518469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.518657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.518788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.518893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.518952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.519100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.519175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.519260] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.559402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.559402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.559402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.559402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.559402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.559402] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 809.571674] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_rules [ 809.571981] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 809.572241] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 809.572633] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 809.572810] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_rules [ 809.572972] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 809.573154] env[65511]: INFO networking_nsxv3.common.synchronization [req-fad825d4-9dff-4183-ac4e-672fb52faf5d req-8b66a40c-8bc9-4258-8d0d-77468289b336 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 809.574292] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_rules [ 809.574390] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_rules [ 809.575208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 809.575208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with Priority: HIGHEST for action port [ 809.575208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_rules [ 809.575208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 809.575208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 809.575612] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dc1dadc-11e9-4539-b83b-670064a2270d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.575749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.575839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.576171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.576290] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.579842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.579842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.579842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.579842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.579842] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.579842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.579842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.580301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.580301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.580301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.580741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.580835] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.582947] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.582947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.582947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.583136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.583194] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.585209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc1dadc-11e9-4539-b83b-670064a2270d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.585305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.585571] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.585655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.592730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.592879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.592952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.593224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.593367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.611165] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 809.857919] env[65511]: INFO networking_nsxv3.common.synchronization [req-ce15c123-e15e-46b4-a2fa-26752bd585a5 req-66023390-6c78-4d28-944b-a9959e52a36b service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 809.857919] env[65511]: INFO networking_nsxv3.common.synchronization [req-ce15c123-e15e-46b4-a2fa-26752bd585a5 req-66023390-6c78-4d28-944b-a9959e52a36b service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 809.857919] env[65511]: INFO networking_nsxv3.common.synchronization [req-ce15c123-e15e-46b4-a2fa-26752bd585a5 req-66023390-6c78-4d28-944b-a9959e52a36b service nova] Enqueued Resource ID: 79fdca1a-06c3-446c-9acb-f7212f37266b with Priority: HIGHEST for action port [ 809.858780] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 809.858912] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 809.859045] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79fdca1a-06c3-446c-9acb-f7212f37266b with Priority: HIGHEST for action port [ 809.859326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.859559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.859559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.859711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.859795] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.860728] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.860823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.861119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-79fdca1a-06c3-446c-9acb-f7212f37266b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.861119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.861249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.861482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.861482] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79fdca1a-06c3-446c-9acb-f7212f37266b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.018661] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.031766] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.031766] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.087032] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a with status ACTIVE [ 810.087202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.087363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.087472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.087750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.087855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.088074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.088229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.088329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.088507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.088653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.088856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.089026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.089104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.089263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.089341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.089463] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a is going to be updated. [ 810.090924] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.091262] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc1dadc-11e9-4539-b83b-670064a2270d taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.091374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.113296] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.113448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.116926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.117084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.117153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.117375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.117498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.117662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db18ee6e-9ad5-4bfb-8dc9-76b9a9150e3a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.363512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.363680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.363931] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79fdca1a-06c3-446c-9acb-f7212f37266b with status ACTIVE [ 810.364178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.364297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.364400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.364675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.364881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.365150] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.365363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.365363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.365559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.365650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.365850] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.365948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.366031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.366236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.366309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.366341] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79fdca1a-06c3-446c-9acb-f7212f37266b is going to be updated. [ 810.389865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.390077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.390145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.390776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.390776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.390776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79fdca1a-06c3-446c-9acb-f7212f37266b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.531295] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.532469] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.535105] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.996189] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 810.996189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035273] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.035734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.035734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.036117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.036212] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d is going to be created. [ 811.038251] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.038456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.038528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.038738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.038828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.038965] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be updated. [ 811.040722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.040905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.041032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.041299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.041444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.041591] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 811.076222] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.076222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.076504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.076887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.077123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.079835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.080181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.080261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.080536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.080715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.084108] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.084294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.084395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.084663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.084862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.091717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.092046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.092046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.092301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.092455] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.095206] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc1dadc-11e9-4539-b83b-670064a2270d in Status: UNINITIALIZED for 2s [ 811.095966] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 811.098141] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 811.267963] env[65511]: INFO networking_nsxv3.common.synchronization [None req-276ad0b7-fb60-4490-a271-6f76814a2009 None None] Enqueued Resource ID: 9218caa5-7437-4b70-b423-b9eeef97f16a with Priority: HIGHEST for action port [ 811.268686] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9218caa5-7437-4b70-b423-b9eeef97f16a with Priority: HIGHEST for action port [ 811.269015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9218caa5-7437-4b70-b423-b9eeef97f16a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.269149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9218caa5-7437-4b70-b423-b9eeef97f16a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.269228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9218caa5-7437-4b70-b423-b9eeef97f16a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.269593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9218caa5-7437-4b70-b423-b9eeef97f16a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.269701] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9218caa5-7437-4b70-b423-b9eeef97f16a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.596515] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.622597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 811.622776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.622987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.623268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.623502] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.623643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.623717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.623926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.624059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.624177] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.774711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9218caa5-7437-4b70-b423-b9eeef97f16a [ 811.774961] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.777206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.777206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.777206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.777206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.777206] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9218caa5-7437-4b70-b423-b9eeef97f16a already deleted. [ 811.777206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9218caa5-7437-4b70-b423-b9eeef97f16a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.099096] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.126914] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.248321] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ca781df-2f20-433c-84be-6ab6698c35f7 req-f765a73d-0616-4d2e-a929-e337c50ea21a tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 812.250032] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 812.250351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.251190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.601620] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 812.601620] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 812.607584] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-898 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.607803] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.607935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.608257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.608515] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.608670] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.608766] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.608971] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.609117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.609320] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.609424] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.609537] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.609669] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.609820] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.609885] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.609985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.629432] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.634404] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.634524] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.634663] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.634837] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-898" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.635282] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-28c427a1-33bb-45e5-aaf3-0e32820fefd1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.635547] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.635671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.636015] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.636261] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c427a1-33bb-45e5-aaf3-0e32820fefd1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.108130] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 813.108505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.109204] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc1dadc-11e9-4539-b83b-670064a2270d in Status: SUCCESS [ 813.109466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.109649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.109892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.110121] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.110305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.110305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.110468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.110586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.110654] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.111673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113521] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.113521] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.127050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 813.127620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.128256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.128603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.128895] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.129244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.129383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.129714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.129714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.129824] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.135123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.135123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.135123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.135123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.135123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.135123] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 813.139560] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.139560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.139795] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.140302] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.140807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.140807] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 28c427a1-33bb-45e5-aaf3-0e32820fefd1 not found, creating... [ 813.140974] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.141149] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.141258] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.141502] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.142169] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.142169] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.142359] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.142489] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.142705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.142844] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.142980] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 28c427a1-33bb-45e5-aaf3-0e32820fefd1 is going to be created. [ 813.168271] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.168481] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.168618] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.169036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.169444] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.170049] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.175863] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.176017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.176106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.176376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.176620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.192210] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 813.612892] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.613046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.613119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.613348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.626719] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 813.628207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.630127] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 813.632396] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.635038] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.635038] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.671473] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.673187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.678709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.679384] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 813.679469] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 813.679563] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 813.726238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.726529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.727585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.727873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.729553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.729778] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 813.804842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.805286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.805286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.805394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.805640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.805928] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 813.914383] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.914383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.914383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.914383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.915469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.916096] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 813.917814] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e5dfcc09-13b8-4365-8bfc-bcfd5a191d58', 'adb88e63-b602-4823-96eb-a58a3e31f8a1', 'a6768aa0-c3a8-4794-8747-efcb8cb86558', '741f5f8c-49a5-4265-ad93-44b10c8b3e1a', '323c831e-3e57-4559-b403-13f13a8cf909', '591b3b3b-b754-4346-a3c6-b62daea076eb', '58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502', '2226f194-d814-4c64-80d7-5b7c97e1019e', 'f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968', 'f4aa4c41-7e6c-4db5-9705-5907decf8f0a', '1790ab65-8d50-4bf4-aa35-1b139b74d5a6', '264b2244-7780-4186-84f6-37be29843260', '1b3f50d6-1505-4f60-b90b-731edbc55041', '8b750c76-b8f3-4b0d-bc94-0a41af53a8cf', '49eab9c1-0cf4-4ab1-83f1-830592c0f740', '2342fbe7-800e-4cc9-9b5f-49749f5d38b2', 'c75da86d-70ea-4fc8-86a4-c249315ae94c', '0211564f-7b41-42e2-85dc-08114fde7981', 'c553cc08-e219-4e38-a548-11dc094c8dd7', 'ad443118-3368-4228-ba77-45b8d1ef4512', '1502e09d-ef5c-4d75-b759-794a7bb5c0cf', '897a9691-2826-4bf1-8977-6d7594c8df89', '1dd306dd-83f9-434d-a479-235e5cd1d98f', 'b0f00d64-0787-45ef-b61c-8c6c22be615c', '6f6d2b7b-7f21-42a2-84a8-572f5519d7d0', 'ee64cf57-98ae-44f7-84e3-20cf3c5c2489', '95d278ea-5c85-431d-b2c5-e2b81a141e5f', '9441a081-4c23-4898-9876-4df61d261ed0', 'bc42862b-f71b-41f8-ad04-30546bed9ee5', '232b7b09-b30d-4f2e-95a8-0315ce8667b1', '9d28d366-53ef-44cf-aae9-28a5d620d19b', '964f8cb2-18ad-4766-ae61-bda439ab5514', 'c0746379-de9c-4dc8-baf1-40ed27bd5a2c', '48fd9074-e82c-4b2f-86bc-96c1badeaa2e', 'fd7e334b-4f27-4441-85ca-d5b22f8c8f07'} {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 813.917814] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 813.943618] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.943618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.943618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.943618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.944134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.944134] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 813.944134] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 813.944134] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 813.952159] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ca781df-2f20-433c-84be-6ab6698c35f7 req-5f83437d-d264-4343-b6cf-2c4af9c5620e service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 813.952404] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ca781df-2f20-433c-84be-6ab6698c35f7 req-5f83437d-d264-4343-b6cf-2c4af9c5620e service nova] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 813.952533] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ca781df-2f20-433c-84be-6ab6698c35f7 req-5f83437d-d264-4343-b6cf-2c4af9c5620e service nova] Enqueued Resource ID: 28c427a1-33bb-45e5-aaf3-0e32820fefd1 with Priority: HIGHEST for action port [ 813.953402] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_rules [ 813.953596] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 813.953829] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28c427a1-33bb-45e5-aaf3-0e32820fefd1 with Priority: HIGHEST for action port [ 813.954125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.954239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.954446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.954532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.955526] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-28c427a1-33bb-45e5-aaf3-0e32820fefd1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.955752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.955752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.956030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.956030] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c427a1-33bb-45e5-aaf3-0e32820fefd1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.051075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.051075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.051075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.051760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.052921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.053516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 814.053856] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.056107] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 814.056107] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 814.056107] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGH for action security_group_rules [ 814.056107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.137016] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.138068] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.138754] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.459704] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28c427a1-33bb-45e5-aaf3-0e32820fefd1 with status ACTIVE [ 814.459956] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.460108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.460252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.462039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.462190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.462407] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.462521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.462585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.462778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.462859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.463078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.463176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.463236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.463380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.463502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.463603] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28c427a1-33bb-45e5-aaf3-0e32820fefd1 is going to be updated. [ 814.487623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.487798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.487874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.488102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.488327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.488622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28c427a1-33bb-45e5-aaf3-0e32820fefd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.641781] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.642129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.643064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.643064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.643064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.643064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be updated. [ 814.644799] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.644965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.645391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.645391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.645577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.645765] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 814.647376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.647528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.647627] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.648152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.648152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.648320] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d is going to be updated. [ 814.693574] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.693902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.693902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.694265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.694431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.696938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.696938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.696938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.696938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.697228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.699333] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.699502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.699502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.699734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.699917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.713788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 814.717610] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 814.717610] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc1dadc-11e9-4539-b83b-670064a2270d in Status: IN_PROGRESS for 2s [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [req-ffb59dfc-61d1-43e7-9f5a-2c747b90a272 req-4aa1a256-bc60-4e49-b519-280ec1a412a9 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [req-ffb59dfc-61d1-43e7-9f5a-2c747b90a272 req-4aa1a256-bc60-4e49-b519-280ec1a412a9 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [req-ffb59dfc-61d1-43e7-9f5a-2c747b90a272 req-4aa1a256-bc60-4e49-b519-280ec1a412a9 tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dc1dadc-11e9-4539-b83b-670064a2270d with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad443118-3368-4228-ba77-45b8d1ef4512 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c553cc08-e219-4e38-a548-11dc094c8dd7 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 264b2244-7780-4186-84f6-37be29843260 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591b3b3b-b754-4346-a3c6-b62daea076eb with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a with Priority: HIGH for action security_group_rules [ 814.773056] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.774926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dc1dadc-11e9-4539-b83b-670064a2270d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.774926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.774926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.779034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.779034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.779034] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.779034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6768aa0-c3a8-4794-8747-efcb8cb86558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.779034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.779034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.779034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.779034] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6768aa0-c3a8-4794-8747-efcb8cb86558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.781193] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.781318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.781401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.781604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.781668] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.782601] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.782807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.782994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.783688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.785368] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.789569] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad443118-3368-4228-ba77-45b8d1ef4512 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.789959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.789959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.790500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.790500] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad443118-3368-4228-ba77-45b8d1ef4512',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.794196] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c553cc08-e219-4e38-a548-11dc094c8dd7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.795710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.795710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.795710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.795710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.796081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.796081] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.798091] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.798091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.798091] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.798091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.798091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.798400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.798400] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b750c76-b8f3-4b0d-bc94-0a41af53a8cf',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.799861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.799861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.799861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.799861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.799861] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2342fbe7-800e-4cc9-9b5f-49749f5d38b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.802497] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b3f50d6-1505-4f60-b90b-731edbc55041 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.802673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.802673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.802846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.802932] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b3f50d6-1505-4f60-b90b-731edbc55041',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.804632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-264b2244-7780-4186-84f6-37be29843260 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.804805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.804805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.804996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.805074] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('264b2244-7780-4186-84f6-37be29843260',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.806228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.806665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.806665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.806665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.806791] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.807023] env[65511]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 814.809235] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.809235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.809235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.809235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.809235] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.809667] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.809667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.809790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.809872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.809977] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.810911] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-591b3b3b-b754-4346-a3c6-b62daea076eb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.811033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.811318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.811418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.811459] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('591b3b3b-b754-4346-a3c6-b62daea076eb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.812840] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.812840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.812840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.813099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.813099] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.817163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.817163] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.817163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.817163] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.817163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.817163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.818348] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('741f5f8c-49a5-4265-ad93-44b10c8b3e1a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.823649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.823649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.823649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.823649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.823649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.824393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.824393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.824393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.824393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.824393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.824393] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.827873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.827998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.828074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.828249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.828413] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.828510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.828590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.828747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.828822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.828906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.829010] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.025871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.026113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.026113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.026378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.055352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.055526] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6768aa0-c3a8-4794-8747-efcb8cb86558 is going to be deleted. [ 815.128988] env[65511]: INFO networking_nsxv3.common.synchronization [req-6c60df86-5c11-477b-a0e3-611615a86051 req-be7dd44d-e3d4-4a13-927b-ace3e4b70f6d tempest-ServerAddressesNegativeTestJSON-1816121 tempest-ServerAddressesNegativeTestJSON-1816121-project-member] Enqueued Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 815.128988] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 815.131743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.133073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.133149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.133457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.133645] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.133754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.133986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.133986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.134105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.134176] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.135852] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.135981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.140015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.140842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.140842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.140842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6768aa0-c3a8-4794-8747-efcb8cb86558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.206447] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 815.206722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.207366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.207989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.207989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.207989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.207989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.208172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.208202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.208335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.208385] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.213655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.213892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.214092] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.214210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.214262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.216040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.216040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.216040] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.339161] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.339161] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.353855] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.354081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.354081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.354799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.378155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.378155] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be deleted. [ 815.435661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.435661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.435661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.435661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.435661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.435661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.537349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.537514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.537583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.537844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.538239] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.538239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.538418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.538470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.538522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.538659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.538733] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.545871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.546127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.546127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.546295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.549412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.549412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.549412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.549412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.549412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.549412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.549412] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.555692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.555692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.555851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.555968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.556165] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.559503] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.559503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.559503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.559503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.559503] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.565957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.569474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.569474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.569474] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.592425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.592644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.592717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.592939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.614250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.614250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.615841] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.616648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.622477] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.622693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.623977] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.623977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.625055] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.625202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.626173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.626299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.628347] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.628477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.629482] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.629604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.630596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.630759] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 741f5f8c-49a5-4265-ad93-44b10c8b3e1a is going to be deleted. [ 815.632365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.632637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.642195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.642329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.648134] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.648367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-887" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.648486] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-887" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.648974] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-887" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.649090] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.649240] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.649351] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.649562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.649707] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.649902] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.650017] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.650122] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.650221] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.650321] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.650419] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.650547] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.660280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.660376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 591b3b3b-b754-4346-a3c6-b62daea076eb is going to be deleted. [ 815.661730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.661952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.678851] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.679028] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.680127] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.680127] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-887" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.680127] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-04bf9c96-d99f-4ab1-a161-77b1b3bec083 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.680127] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.680127] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.680403] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.680531] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04bf9c96-d99f-4ab1-a161-77b1b3bec083',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.702096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.702096] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2342fbe7-800e-4cc9-9b5f-49749f5d38b2 is going to be deleted. [ 815.703474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.703667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.705890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.706113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.713066] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.714425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.719041] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.730328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.730506] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad443118-3368-4228-ba77-45b8d1ef4512 is going to be deleted. [ 815.731528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.731723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.733949] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.734128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.766883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767072] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968 is going to be deleted. [ 815.768294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.768574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.796065] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.796294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.810928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.811180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.833018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.833211] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be deleted. [ 815.834349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.834573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.841504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 815.842674] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502: rpc.has_security_group_logging(os_id): False [ 815.879573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.879810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.898506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.898671] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b750c76-b8f3-4b0d-bc94-0a41af53a8cf is going to be deleted. [ 815.899644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.900578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.909227] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.909443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.936055] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.936055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.968578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.968783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b3f50d6-1505-4f60-b90b-731edbc55041 is going to be deleted. [ 815.969667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.969883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.043659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.043659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.043659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.043659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.043659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.044397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.044397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.044397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.044397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.044397] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.045183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.045330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.046196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.046312] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 264b2244-7780-4186-84f6-37be29843260 is going to be deleted. [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.049029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.049029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.049535] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 already deleted. [ 816.049535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.049596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.049788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.049872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.049991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-741f5f8c-49a5-4265-ad93-44b10c8b3e1a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.050634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.050803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.050883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.051013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-591b3b3b-b754-4346-a3c6-b62daea076eb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.051565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.051565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.051565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.051565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2342fbe7-800e-4cc9-9b5f-49749f5d38b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.051701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.051734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.051803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.051899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad443118-3368-4228-ba77-45b8d1ef4512" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.052033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.052172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.052243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.052352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0b9eaa0-cb18-43ab-b3f5-e9ff04ecf968" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.052471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.052607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.053786] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.059967] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.060188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.061535] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.062692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.062852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.062941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.063189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.063422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.063554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.063554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.064012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.064012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.064012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.064177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.064246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.064306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.064456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.064623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.064715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.064782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.064914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.064992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.065083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.065167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.076982] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.093058] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.093235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.109325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.109658] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.109759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.109864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.110143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.110223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.110330] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 816.111661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.111877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.165939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.166390] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.166509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.166509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.166786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.167121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.167121] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 816.168566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.168755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.168842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.168963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b750c76-b8f3-4b0d-bc94-0a41af53a8cf" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.169108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.169281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.169511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.169598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b3f50d6-1505-4f60-b90b-731edbc55041" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.170121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.170278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.170358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.170555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.184201] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.184417] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.184781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.184781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.184965] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.185090] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 04bf9c96-d99f-4ab1-a161-77b1b3bec083 not found, creating... [ 816.185355] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.185583] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.185701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186020] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.186120] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.186360] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.186538] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.186972] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.187207] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 04bf9c96-d99f-4ab1-a161-77b1b3bec083 is going to be created. [ 816.190084] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.190238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.190238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.190346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.190407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.190527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-264b2244-7780-4186-84f6-37be29843260" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.213193] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.213718] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.213718] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.213907] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.214073] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.214311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.223202] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.314578] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.314726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.314786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.314995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.315201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.317274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.317484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.317484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.317649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.317791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.347810] env[65511]: INFO networking_nsxv3.common.synchronization [req-d952224f-0dce-4803-8cb6-75f5e8cb551e req-b69ac535-178f-4a75-918a-548c26f1c676 tempest-ServersAdminNegativeTestJSON-511239178 tempest-ServersAdminNegativeTestJSON-511239178-project-member] Enqueued Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 816.348775] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 with Priority: HIGHEST for action security_group_members [ 816.349119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.349244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.349311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.349526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.349679] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.349774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.349962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.350037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.350088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.350163] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f6d2b7b-7f21-42a2-84a8-572f5519d7d0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.395559] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 816.396510] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 816.551776] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adb88e63-b602-4823-96eb-a58a3e31f8a1: rpc.has_security_group_logging(os_id): False [ 816.556490] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2226f194-d814-4c64-80d7-5b7c97e1019e: rpc.has_security_group_logging(os_id): False [ 816.568156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0211564f-7b41-42e2-85dc-08114fde7981: rpc.has_security_group_logging(os_id): False [ 816.569302] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 816.573060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.573280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.573384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.573614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.575171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.575321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.579302] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 323c831e-3e57-4559-b403-13f13a8cf909: rpc.has_security_group_logging(os_id): False [ 816.596645] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.596841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.597614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.597704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.598398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.598491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.601303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.601519] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.601630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.601695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.601899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.601982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.602192] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.602288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.602348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.602546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.602642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.602756] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.602834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.602889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.603042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.603117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.603252] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 816.604526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.604526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.625833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.626149] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.626246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.626443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.626983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.626983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.626983] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be updated. [ 816.627819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.627990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.658628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.659315] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.659315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.659315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.659941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.660206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.660452] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 816.661677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.662053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.690028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.690028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.690028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.690028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.690728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.690728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.690728] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 816.693698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.694683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.698388] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.698388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.703221] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.703221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.725265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.725447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.725528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.725790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.725896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.725997] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 816.728328] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dc1dadc-11e9-4539-b83b-670064a2270d in Status: SUCCESS [ 816.728328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.729171] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 816.729306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.730080] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 816.730291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.731092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.731092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.731092] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.731092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.731092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.731388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.731388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.731388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.731388] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.732230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.732875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.732875] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.732875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.732875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.732875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.733140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.733140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.733140] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.733857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.734033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.734183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.734280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.734867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.734867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.734867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.734867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.734867] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.736231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.736481] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.736574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.736638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.736898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.736898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.737064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 816.738789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.738841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.738994] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.739145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.739674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.739674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.739674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.739674] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.740757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.740757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.740757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.740757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.740757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.740956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.740956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.741088] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.745021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.745021] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.745021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.768353] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.768553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.768660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.768875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.770488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.777842] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: IN_PROGRESS for 2s [ 816.806221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 816.814628] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 816.816703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.817192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.817344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.819271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.819415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.819453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.819610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.819747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.843071] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 816.852754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.852899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.852939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.853318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.865558] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 816.903681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.903681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.909772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.909772] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.909772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.909772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.910429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.910429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.910429] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 is going to be updated. [ 816.911238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.911601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.911601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.926638] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 816.957177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.957177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.957177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.957177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.957374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.974087] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: IN_PROGRESS for 2s [ 817.047571] env[65511]: INFO networking_nsxv3.common.synchronization [req-6c60df86-5c11-477b-a0e3-611615a86051 req-0d444848-5768-421f-a864-6042ab58af2e service nova] Enqueued Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_rules [ 817.047571] env[65511]: INFO networking_nsxv3.common.synchronization [req-6c60df86-5c11-477b-a0e3-611615a86051 req-0d444848-5768-421f-a864-6042ab58af2e service nova] Enqueued Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 817.047571] env[65511]: INFO networking_nsxv3.common.synchronization [req-6c60df86-5c11-477b-a0e3-611615a86051 req-0d444848-5768-421f-a864-6042ab58af2e service nova] Enqueued Resource ID: 04bf9c96-d99f-4ab1-a161-77b1b3bec083 with Priority: HIGHEST for action port [ 817.048506] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_rules [ 817.048907] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 817.049185] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf9c96-d99f-4ab1-a161-77b1b3bec083 with Priority: HIGHEST for action port [ 817.050722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.050722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.050722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.050722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.050722] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.051358] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.051583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.051583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.051832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.052965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.052965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.052965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.052965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.052965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.052965] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.053544] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-04bf9c96-d99f-4ab1-a161-77b1b3bec083 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.053660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.053716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.053878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.053967] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04bf9c96-d99f-4ab1-a161-77b1b3bec083',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.238736] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.240518] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dc1dadc-11e9-4539-b83b-670064a2270d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.248541] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.249429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.249429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.249429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.249429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.249429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.250630] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.250847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.250973] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.275551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.275956] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.276130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.276130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.276743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.276743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.276743] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be updated. [ 817.278244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.278467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.278803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279103] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.279103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.279103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279520] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d is going to be deleted. [ 817.357764] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.357965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.357965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.358192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.358384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.372455] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 817.419720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.419879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.419946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.420183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.420281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.420382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.559133] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.559133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.559133] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.559548] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04bf9c96-d99f-4ab1-a161-77b1b3bec083 with status ACTIVE [ 817.559788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.559944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.560048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.560280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.560386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.560611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.560748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.560821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.565774] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.565774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.565774] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04bf9c96-d99f-4ab1-a161-77b1b3bec083 is going to be updated. [ 817.591256] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.591441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.591521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.591742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.591886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.592078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04bf9c96-d99f-4ab1-a161-77b1b3bec083" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.740663] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c553cc08-e219-4e38-a548-11dc094c8dd7: rpc.has_security_group_logging(os_id): False [ 817.743577] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dc1dadc-11e9-4539-b83b-670064a2270d: rpc.has_security_group_logging(os_id): False [ 817.755276] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.761543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.761646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.761738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.762228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.762228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.762228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.762646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.762646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.762646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.762646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.762761] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be updated. [ 817.764628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.764767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.764767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.765154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.765154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.765401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.765401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.765401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.765566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.765607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.765811] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d is going to be created. [ 817.786993] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d], does not exist path=[/infra/domains/default/groups/0dc1dadc-11e9-4539-b83b-670064a2270d]."\n}' [ 817.787246] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d [ 817.787246] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 817.822746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.823374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.823374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.823517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.824820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.825042] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.825223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.825323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.825952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.825952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.826195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.826350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.826460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.826698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.826824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.826959] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dc1dadc-11e9-4539-b83b-670064a2270d is going to be created. [ 817.829943] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.830112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.830172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.830501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.830689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.858274] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: IN_PROGRESS for 2s [ 817.861261] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d], does not exist path=[/infra/domains/default/groups/0dc1dadc-11e9-4539-b83b-670064a2270d]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d [ 817.861435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dc1dadc-11e9-4539-b83b-670064a2270d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.862258] env[65511]: Traceback (most recent call last): [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 817.862328] env[65511]: return func(*args, **kwargs) [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 817.862328] env[65511]: res.raise_for_status() [ 817.862328] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 817.862328] env[65511]: raise HTTPError(http_error_msg, response=self) [ 817.862328] env[65511]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d [ 817.862328] env[65511]: During handling of the above exception, another exception occurred: [ 817.862328] env[65511]: Traceback (most recent call last): [ 817.862328] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 817.862328] env[65511]: listener.cb(fileno) [ 817.862328] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 817.862328] env[65511]: result = function(*args, **kwargs) [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 817.862328] env[65511]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 817.862328] env[65511]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 817.862328] env[65511]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 817.862328] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 817.862328] env[65511]: res.raise_for_status() [ 817.862328] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 817.862328] env[65511]: raise HTTPError(http_error_msg, response=self) [ 817.862328] env[65511]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0dc1dadc-11e9-4539-b83b-670064a2270d [ 817.863130] env[65511]: Removing descriptor: 5 [ 817.944733] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-3c4a5bfe-acf9-4489-a4f8-6d07b6edd551 tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 817.945361] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 817.946205] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.946205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.946205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.946633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.946633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.946723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.946789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.946983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.947103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.947237] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.068199] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.258606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.258606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.258606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.259090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.259090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.259090] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 818.315658] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.315827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.315898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.316144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.316307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.333779] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 818.357275] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.357275] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.357275] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.357705] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.357705] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.357705] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.357705] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.357841] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.357871] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.358276] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.381555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.381690] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.381819] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.382057] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.382373] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-6509b5c0-7068-4d10-977b-573710c8d9e1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.382541] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.382651] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.383197] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.383399] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6509b5c0-7068-4d10-977b-573710c8d9e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.415726] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 818.415965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.416856] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 818.417079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.450758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.450923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.450995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.451291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.451404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.451608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.451755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.451839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.452027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.452143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.452253] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b already deleted. [ 818.452422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.575543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.575543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.575543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.575543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.575543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.575543] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 is going to be created. [ 818.609815] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.609999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.609999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.610223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.610399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.621960] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: UNINITIALIZED for 2s [ 818.793457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: SUCCESS [ 818.793830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.818273] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 818.818484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.825214] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 818.825497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.852317] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 818.852769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.852859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.853478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.853478] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.853662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.853662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.853867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.854055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.854208] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.880945] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 818.880945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.885459] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.885459] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.885628] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.885836] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.885989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.886164] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 6509b5c0-7068-4d10-977b-573710c8d9e1 not found, creating... [ 818.886424] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.886602] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.886715] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.886932] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.887100] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.887380] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.887527] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.887639] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.887836] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.887959] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.888111] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 6509b5c0-7068-4d10-977b-573710c8d9e1 is going to be created. [ 818.909355] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.909557] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.909674] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.910055] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.910200] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.910421] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.942888] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 818.943723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.990437] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 in Status: SUCCESS [ 818.990636] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f6d2b7b-7f21-42a2-84a8-572f5519d7d0 deletion is rescheduled due to dependency. [ 818.990762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f6d2b7b-7f21-42a2-84a8-572f5519d7d0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.357052] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.383618] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 819.383618] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 deletion is rescheduled due to dependency. [ 819.383618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.626321] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-428b051c-331c-429c-9ad2-f0b84f4992ab service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 819.626321] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-428b051c-331c-429c-9ad2-f0b84f4992ab service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 819.626321] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-428b051c-331c-429c-9ad2-f0b84f4992ab service nova] Enqueued Resource ID: 6509b5c0-7068-4d10-977b-573710c8d9e1 with Priority: HIGHEST for action port [ 819.626321] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 819.626321] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 819.627070] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6509b5c0-7068-4d10-977b-573710c8d9e1 with Priority: HIGHEST for action port [ 819.628677] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.629430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.629430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.629430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.629430] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.630370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.630734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.630813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.631093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.631279] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.631443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.632123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.632292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.632381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.632481] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.633680] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6509b5c0-7068-4d10-977b-573710c8d9e1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.633680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.633680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.634935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.635041] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6509b5c0-7068-4d10-977b-573710c8d9e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.860561] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.879064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c553cc08-e219-4e38-a548-11dc094c8dd7 in Status: SUCCESS [ 819.879494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.880348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.880557] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c553cc08-e219-4e38-a548-11dc094c8dd7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.141343] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.141343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.141343] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.141857] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6509b5c0-7068-4d10-977b-573710c8d9e1 with status ACTIVE [ 820.141929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.142034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.143084] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.143084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.143608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.143795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.143862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.144029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.144107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.144253] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6509b5c0-7068-4d10-977b-573710c8d9e1 is going to be updated. [ 820.171422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.171610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.171689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.171938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.172402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.174149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6509b5c0-7068-4d10-977b-573710c8d9e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.347354] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 820.347354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.347354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.347354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.347596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.347655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.348671] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.349418] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.349418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.349418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.354844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.354844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.354844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.354844] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.366392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.367382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.367382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.367382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.367382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.367382] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 820.406707] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.406707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.406707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.406707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.406707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.406707] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c553cc08-e219-4e38-a548-11dc094c8dd7 is going to be deleted. [ 820.414629] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.414795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.414895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.425902] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 820.482248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.482248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.482573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.482573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.482672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.482719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c553cc08-e219-4e38-a548-11dc094c8dd7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.634481] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: SUCCESS [ 820.634707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.634893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.635150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.635854] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.636017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.636093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.636280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.636366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.637192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.637192] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.650358] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.659857] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-6e26366a-a0a1-4779-9067-c25c55abcf35 tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 820.660418] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 820.661102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.661273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.856641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0746379-de9c-4dc8-baf1-40ed27bd5a2c: rpc.has_security_group_logging(os_id): False [ 820.883904] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.884291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.884291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.884569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.914510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.914616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.915595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.915595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.916098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.916098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.916098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.916098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.916236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.916236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.916314] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 821.021656] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.021656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.021656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.021656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.021656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.046864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 821.139824] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.139824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.139824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.140274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.140351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.140459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.140492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.140640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.140754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.140898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.141253] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.141341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.141376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.141567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.141783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.141890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.141985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.142247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.142333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.142445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.142567] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.153292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.153483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.153655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.153994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.154079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.154241] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be created. [ 821.161825] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.161956] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.162092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.163627] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.163627] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.163627] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.163627] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.163627] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.164281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.164281] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.164281] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.164422] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.164979] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.164979] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.164979] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.165254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.174952] env[65511]: INFO networking_nsxv3.common.synchronization [req-e4ee7ac1-45b6-411b-8c8b-da83fe8e07c2 req-8bb89e26-b002-47ad-bbfe-14dc610462cb tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 821.176063] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 821.176379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.176537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.176627] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.176882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.177115] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.177273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.177330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.178344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.178344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.178344] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.186190] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.186553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.186632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.186929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.187240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.203031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.203031] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.203031] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.203031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.203031] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-e2158500-c2a6-4b2b-85c9-58da4e1f228c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.203031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.203031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.203031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.203031] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2158500-c2a6-4b2b-85c9-58da4e1f228c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.206817] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: UNINITIALIZED for 2s [ 821.645891] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08f1abb3-effb-4f78-bdf9-5bf8159bab78: rpc.has_security_group_logging(os_id): False [ 821.672198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.672198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.672198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.672498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.672498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.672621] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.672798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.672798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.673092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.673165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.673381] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.673523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.673574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.673744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.673825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.674035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.674135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.674196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.674392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.674425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.674497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 is going to be created. [ 821.685014] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.685014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.685014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.685302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.706450] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.706807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.707030] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.707544] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.707860] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.708137] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port e2158500-c2a6-4b2b-85c9-58da4e1f228c not found, creating... [ 821.708420] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.708646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.708896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.709231] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.709397] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.709777] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.710036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.710208] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.710505] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.710703] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.710899] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: e2158500-c2a6-4b2b-85c9-58da4e1f228c is going to be created. [ 821.713529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.713790] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.713928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.714046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.714311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.714393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.714528] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 821.735572] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.735915] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.737893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.737893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.737893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.737893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.746671] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.746671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.746671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.746671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.746671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.748130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.748253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.748313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.748500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.748629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.766774] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 821.767608] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: IN_PROGRESS for 2s [ 822.439203] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 822.439203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.439203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.439203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.439203] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.439203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.439448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.439448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.440701] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.440701] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.440701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.442033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.442126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.442427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.442427] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.492102] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-ab395ace-b7e6-491a-9c36-951bd6ac5606 service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 822.492102] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-ab395ace-b7e6-491a-9c36-951bd6ac5606 service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 822.492102] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-ab395ace-b7e6-491a-9c36-951bd6ac5606 service nova] Enqueued Resource ID: e2158500-c2a6-4b2b-85c9-58da4e1f228c with Priority: HIGHEST for action port [ 822.492565] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 822.492763] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 822.492873] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2158500-c2a6-4b2b-85c9-58da4e1f228c with Priority: HIGHEST for action port [ 822.493208] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.493310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.493523] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.493675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.494130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2158500-c2a6-4b2b-85c9-58da4e1f228c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.494241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.494305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.494902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.494993] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2158500-c2a6-4b2b-85c9-58da4e1f228c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.945318] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c75da86d-70ea-4fc8-86a4-c249315ae94c: rpc.has_security_group_logging(os_id): False [ 822.976786] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.977034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.977034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.977263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.996918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2158500-c2a6-4b2b-85c9-58da4e1f228c with status ACTIVE [ 822.997231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.997440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.997440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.997613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.997709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.997900] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.997994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.998089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.998229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.998312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.998491] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.998594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.998646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.998773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.998843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.998929] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2158500-c2a6-4b2b-85c9-58da4e1f228c is going to be updated. [ 823.001337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.001438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.001576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.001702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.001883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.001965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.002191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.002330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.002415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.002552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.002643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.002838] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.002955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.003028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.003143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.003226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.003322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 823.040393] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.040393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.040393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.040393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.040393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.040393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2158500-c2a6-4b2b-85c9-58da4e1f228c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.091856] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 823.092183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.106396] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.106587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.106708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.106887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.107064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.130513] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 823.228832] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 823.228832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.229533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.229533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.229789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.229789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230597] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.232244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.233102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.233102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.233102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.233102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.233102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.233450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.233450] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.465043] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-f2ddaade-efcf-4e64-b175-6e5e512cf609 tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 823.465654] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 823.465997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.469483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.738259] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.782699] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 823.782940] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 823.783118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.793022] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: SUCCESS [ 823.793308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.933503] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.933706] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.933824] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.934096] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.934348] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.934497] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.934603] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.934812] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.935171] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.935460] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.935605] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.935716] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.935818] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.935921] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.936028] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.936156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.954605] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.954953] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.955053] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.955269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-793" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.955650] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-82c4a506-0895-48dc-b2f7-39b324a3190e taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.955898] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.956088] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.956445] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.956652] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c4a506-0895-48dc-b2f7-39b324a3190e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.246234] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.458635] env[65511]: INFO networking_nsxv3.common.synchronization [req-e7281e4d-fcec-4f46-8c17-ae0379e6cae2 req-2547e834-b1e1-4f98-9446-6b43b8abb998 tempest-ServersTestFqdnHostnames-9397888 tempest-ServersTestFqdnHostnames-9397888-project-member] Enqueued Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 824.459014] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.459646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.459646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.459646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.459791] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.459826] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 82c4a506-0895-48dc-b2f7-39b324a3190e not found, creating... [ 824.460370] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.460370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.460370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.460567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.460622] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.460921] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.461046] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.461148] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.461336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.461461] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.461599] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 82c4a506-0895-48dc-b2f7-39b324a3190e is going to be created. [ 824.462611] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 with Priority: HIGHEST for action security_group_members [ 824.463120] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.463223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.463287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.463433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.463989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.463989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.463989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.463989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.463989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.464207] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee64cf57-98ae-44f7-84e3-20cf3c5c2489',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.484142] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.484784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.484784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.484784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.484923] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.485172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.748805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.749174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.749312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.749689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.749817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.749954] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 824.781778] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.781935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.782011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.782237] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.782385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.791877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 824.966963] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.966963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.966963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.968896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.993232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.993950] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.993950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.993950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.994239] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 is going to be updated. [ 825.029106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.029562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.029776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.030120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.030419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.042485] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: IN_PROGRESS for 2s [ 825.146421] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 825.146920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.147356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.147630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.147630] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.300743] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-1482c7c0-3b50-40cc-845b-de9c8443c50a service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 825.301025] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-1482c7c0-3b50-40cc-845b-de9c8443c50a service nova] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 825.301099] env[65511]: INFO networking_nsxv3.common.synchronization [req-f92963bc-7224-4d91-98a5-128742bd961d req-1482c7c0-3b50-40cc-845b-de9c8443c50a service nova] Enqueued Resource ID: 82c4a506-0895-48dc-b2f7-39b324a3190e with Priority: HIGHEST for action port [ 825.301819] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_rules [ 825.302015] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 825.303023] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c4a506-0895-48dc-b2f7-39b324a3190e with Priority: HIGHEST for action port [ 825.305901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.305901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.305901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.305901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.305901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c4a506-0895-48dc-b2f7-39b324a3190e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.305901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.305901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.305901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.305901] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c4a506-0895-48dc-b2f7-39b324a3190e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.656822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.656822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.656999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.657120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.657294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.657395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.657459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.657610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.657698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.657785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.657876] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.809772] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82c4a506-0895-48dc-b2f7-39b324a3190e with status ACTIVE [ 825.810041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.810184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.810255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.810465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.810552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.810732] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.810838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.810886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.811088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.811141] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.811329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.811421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.811473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.811612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.811684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.811768] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82c4a506-0895-48dc-b2f7-39b324a3190e is going to be updated. [ 825.843594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.843696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.843791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.844023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.844203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.844319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c4a506-0895-48dc-b2f7-39b324a3190e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.166261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.166261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.166261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.166760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.166760] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.166760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.166760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.166920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.166920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.166985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.168078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168627] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.672016] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c75da86d-70ea-4fc8-86a4-c249315ae94c: rpc.has_security_group_logging(os_id): False [ 826.696371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.697456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.697456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.697456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.697456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.697456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.697456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.697869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.697869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.698069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.698370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.698370] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 826.779326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.779525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.779525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.781022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.781022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.807021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.807021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.807021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.807021] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.808392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 827.056063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 in Status: SUCCESS [ 827.056457] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee64cf57-98ae-44f7-84e3-20cf3c5c2489 deletion is rescheduled due to dependency. [ 827.056611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee64cf57-98ae-44f7-84e3-20cf3c5c2489" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.313833] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.821200] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.326776] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.327938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.327938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.327938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.327938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.327938] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 828.364966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.365192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.365291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.365593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.365867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.380286] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 828.762889] env[65511]: INFO networking_nsxv3.common.synchronization [req-8cfdb1ab-6e49-49f8-9cd1-f4c979fd8564 req-072cbb80-59dc-48bb-8891-7b78084cd348 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 828.763624] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 828.764012] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.767514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.769962] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.769962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.769962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.828109] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 828.828728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.829397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.829662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.829758] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.230468] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.230681] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.230813] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.231121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.231789] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.232011] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.232100] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.232447] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.232519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.232719] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.232901] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.233055] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.233199] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.233333] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.233446] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.233660] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.257920] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.258162] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.258241] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.258620] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.258729] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-b7184ebb-fa94-43d3-bf41-938fc4217af1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.258898] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.259022] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.259356] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.259461] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7184ebb-fa94-43d3-bf41-938fc4217af1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.273148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.273326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.273376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.273817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.273817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.273817] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.273982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.273982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.274141] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.274217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.274303] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e already deleted. [ 829.274380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.332858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.334092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.334092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.334092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.335160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.335160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.335160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.335160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.335160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.335160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.335961] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.761868] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.762187] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.762390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.763036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.763036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.763036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port b7184ebb-fa94-43d3-bf41-938fc4217af1 not found, creating... [ 829.763646] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.763646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.764828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.764828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.764828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.764828] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.766392] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.766700] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.767687] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.767687] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.767687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: b7184ebb-fa94-43d3-bf41-938fc4217af1 is going to be created. [ 829.794881] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.795190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.795348] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.795835] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.796123] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.796363] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.840832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.840832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.840832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.840979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.841189] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.841633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.841766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.841935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.842057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842316] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.842411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.842471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.842749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.843078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.843078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.843078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.843177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.844339] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.025333] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e655e99b-c248-4b70-950a-ebd9a7d52d12 None None] Enqueued Resource ID: bba5c07f-f449-4ac7-af02-ae26bb052a91 with Priority: HIGHEST for action port [ 830.026047] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba5c07f-f449-4ac7-af02-ae26bb052a91 with Priority: HIGHEST for action port [ 830.026379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bba5c07f-f449-4ac7-af02-ae26bb052a91 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.026506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bba5c07f-f449-4ac7-af02-ae26bb052a91" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.026569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bba5c07f-f449-4ac7-af02-ae26bb052a91" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.026893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bba5c07f-f449-4ac7-af02-ae26bb052a91" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.027012] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba5c07f-f449-4ac7-af02-ae26bb052a91',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.065367] env[65511]: INFO networking_nsxv3.common.synchronization [req-81eb904d-378d-4547-a434-925d0a1b3f6d req-cf65e35b-6e0f-4780-9705-882db01d8232 tempest-ServerAddressesNegativeTestJSON-1816121 tempest-ServerAddressesNegativeTestJSON-1816121-project-member] Enqueued Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 830.065958] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGHEST for action security_group_members [ 830.066365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.066480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.066610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.066770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.067182] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.067182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.067182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.067427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.067427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.067427] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.345967] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c75da86d-70ea-4fc8-86a4-c249315ae94c: rpc.has_security_group_logging(os_id): False [ 830.369300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.369473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.369532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.370050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.370050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.370248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.370248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.370332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.370475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.370768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.371068] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.371144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.371192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.371345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.371421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.371615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.371708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.371767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.371908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.371982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.372085] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 830.392406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 830.392644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.392826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.393155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.393376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.393527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.393597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.393759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.393841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.393935] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.442325] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.442489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.442556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.442739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.443757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.458750] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 830.525659] env[65511]: INFO networking_nsxv3.common.synchronization [req-8cfdb1ab-6e49-49f8-9cd1-f4c979fd8564 req-ec75a12b-2d36-430d-a9f4-1e50c17c1f1d service nova] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_rules [ 830.525659] env[65511]: INFO networking_nsxv3.common.synchronization [req-8cfdb1ab-6e49-49f8-9cd1-f4c979fd8564 req-ec75a12b-2d36-430d-a9f4-1e50c17c1f1d service nova] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 830.525659] env[65511]: INFO networking_nsxv3.common.synchronization [req-8cfdb1ab-6e49-49f8-9cd1-f4c979fd8564 req-ec75a12b-2d36-430d-a9f4-1e50c17c1f1d service nova] Enqueued Resource ID: b7184ebb-fa94-43d3-bf41-938fc4217af1 with Priority: HIGHEST for action port [ 830.526851] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_rules [ 830.527266] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 830.530754] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7184ebb-fa94-43d3-bf41-938fc4217af1 with Priority: HIGHEST for action port [ 830.532199] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.532199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.532199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.532199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.532440] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.533706] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bba5c07f-f449-4ac7-af02-ae26bb052a91 [ 830.533990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.534107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.534182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.534716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.534716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.534716] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bba5c07f-f449-4ac7-af02-ae26bb052a91 already deleted. [ 830.534848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bba5c07f-f449-4ac7-af02-ae26bb052a91" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.535054] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.535201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.535263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.535466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.535790] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.536323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.536370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.536619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.536710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.536809] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.540243] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7184ebb-fa94-43d3-bf41-938fc4217af1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.540391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.540449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.541139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.541246] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7184ebb-fa94-43d3-bf41-938fc4217af1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.570587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.570587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.570587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.570587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.571048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.571169] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.572231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.572231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.572231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.572231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.572231] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 is going to be updated. [ 830.619216] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.619420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.619598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.619900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.620101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.630635] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: IN_PROGRESS for 2s [ 830.900127] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.045354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.045546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.045753] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.052846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7184ebb-fa94-43d3-bf41-938fc4217af1 with status ACTIVE [ 831.053266] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.054467] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.054467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.054845] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.054845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.054845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.054960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.055069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.055162] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7184ebb-fa94-43d3-bf41-938fc4217af1 is going to be updated. [ 831.077546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.077744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.077807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.078073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.078239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.078573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7184ebb-fa94-43d3-bf41-938fc4217af1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.110437] env[65511]: INFO networking_nsxv3.common.synchronization [None req-59f8f5e6-92df-4a72-8a4e-b0ed8069f4b4 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 831.111061] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 831.111421] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.111421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.111539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.111714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.111786] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.211997] env[65511]: INFO networking_nsxv3.common.synchronization [None req-612ae7a1-795e-4154-869e-816c6b0d4081 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 831.211997] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 831.211997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.211997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.402812] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.548843] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.636248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.636248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a already deleted. [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.636248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.636718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.636718] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.907148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.907591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.907591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.907725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.907955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.907955] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 831.964254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.964254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.964254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.964254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.964254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.974291] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 832.051050] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.051244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.051284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.051507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.052030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.052030] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be created. [ 832.086631] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.086631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.086631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.086631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.086631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.103711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: UNINITIALIZED for 2s [ 832.160619] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.160761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.160829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.161092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.161180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.161292] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a already deleted. [ 832.161410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.477727] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 832.478122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.643671] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 in Status: SUCCESS [ 832.644046] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 deletion is rescheduled due to dependency. [ 832.644970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.852244] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f76ca82e-a429-45d7-a836-6efe29690621 None None] Enqueued Resource ID: 3d26ef98-f7fb-448d-abae-287bdb410410 with Priority: HIGHEST for action port [ 832.853148] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d26ef98-f7fb-448d-abae-287bdb410410 with Priority: HIGHEST for action port [ 832.853581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d26ef98-f7fb-448d-abae-287bdb410410 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.853581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d26ef98-f7fb-448d-abae-287bdb410410" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.853688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d26ef98-f7fb-448d-abae-287bdb410410" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.853942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d26ef98-f7fb-448d-abae-287bdb410410" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.854039] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d26ef98-f7fb-448d-abae-287bdb410410',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.358754] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d26ef98-f7fb-448d-abae-287bdb410410 [ 833.358996] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.359156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.359236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.359466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.359578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.359683] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d26ef98-f7fb-448d-abae-287bdb410410 already deleted. [ 833.359764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d26ef98-f7fb-448d-abae-287bdb410410" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.987880] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 833.988741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.988741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.988741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.989029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.989029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.989029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.989245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.989312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.989374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.989552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.989628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.989677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.990129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.990129] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.990129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.990129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.990376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.990376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.990376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.990505] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.991433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.992789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.992789] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.992789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.992789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.992789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.992789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.992789] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.114573] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 834.114833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.115017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.115348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.115477] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.115619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.115705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.116208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.116337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.116610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.116742] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.495120] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bef7c22-495d-4b65-b8bf-57eb4115026b: rpc.has_security_group_logging(os_id): False [ 834.496280] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.521431] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.521612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.522054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.522054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.522054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.522606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.522606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.522606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.522606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.522845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.522845] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.523036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.523036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.524755] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.524755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.524755] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be created. [ 834.593634] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.593842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.593887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.609131] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 834.618811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.619092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.619174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.619411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.619613] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.619717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.619783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.619964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.620070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.620156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.620349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.620449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.620562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.620664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.620831] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.620934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.620991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.621161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.621248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.621508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.621508] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.002944] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.125380] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e: rpc.has_security_group_logging(os_id): False [ 835.147755] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.147929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.147929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.148362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.148539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.148885] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.149054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.149224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.149477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.149658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.149964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.150531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.150808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.151059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.151314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.151424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.151751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.151860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.151997] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be created. [ 835.219813] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.219813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.219813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.219813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.219813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.232962] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: IN_PROGRESS for 2s [ 835.409028] env[65511]: INFO networking_nsxv3.common.synchronization [req-f0df9abb-3f44-42ec-8aa5-d5d3985148de req-58178f80-263f-4e14-936f-96b393465840 tempest-ServerRescueTestJSON-356650576 tempest-ServerRescueTestJSON-356650576-project-member] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 835.409318] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGHEST for action security_group_members [ 835.409847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.410145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.410376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.410703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.411033] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.411286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.411507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.411895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.412172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.413560] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.506944] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.506944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.506944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.506944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.506944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.506944] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 835.540450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.543027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.543027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.543027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.543027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.555148] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 835.555148] env[65511]: INFO networking_nsxv3.common.synchronization [None req-19734b56-8bf0-405f-afed-a0a16a20b436 None None] Enqueued Resource ID: c0bb473c-2bb6-49a5-87bd-37dc6feb6450 with Priority: HIGHEST for action port [ 835.555148] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0bb473c-2bb6-49a5-87bd-37dc6feb6450 with Priority: HIGHEST for action port [ 835.555148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0bb473c-2bb6-49a5-87bd-37dc6feb6450 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.556053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0bb473c-2bb6-49a5-87bd-37dc6feb6450" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.556307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0bb473c-2bb6-49a5-87bd-37dc6feb6450" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.556760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0bb473c-2bb6-49a5-87bd-37dc6feb6450" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.557043] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bb473c-2bb6-49a5-87bd-37dc6feb6450',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.916388] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.916388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.916388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.916388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.942195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.942195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.942195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.942195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.942513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.942513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.942571] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be updated. [ 835.989642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.989811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.989851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.990099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.990243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.003567] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: IN_PROGRESS for 2s [ 836.060070] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0bb473c-2bb6-49a5-87bd-37dc6feb6450 [ 836.060317] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.060452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.060520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.060740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.060839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.060942] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0bb473c-2bb6-49a5-87bd-37dc6feb6450 already deleted. [ 836.061035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0bb473c-2bb6-49a5-87bd-37dc6feb6450" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.625038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 836.626368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.626368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.626368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.626368] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.129582] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.129903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.248850] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 837.249466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.566215] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 837.566215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.566215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.566506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.566654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.567397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.567397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.567397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.567397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567718] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.597142] env[65511]: INFO networking_nsxv3.common.synchronization [req-9302bdd8-7767-4fbd-b022-5e4159459701 req-c6d9f338-8782-4ddc-85ba-44142ee6cdf7 tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 837.597684] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 837.598027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.598409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.598483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.598717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.598869] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.598976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.599048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.599230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.599319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.599430] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.014028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 in Status: SUCCESS [ 838.014391] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 deletion is rescheduled due to dependency. [ 838.014553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.071368] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.071506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.105070] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.607759] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.677675] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e0d89c2c-8af8-49a3-b00e-a39c0f849d78 None None] Enqueued Resource ID: fbb17e97-294b-48a1-8190-f1f245d57be6 with Priority: HIGHEST for action port [ 838.677675] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb17e97-294b-48a1-8190-f1f245d57be6 with Priority: HIGHEST for action port [ 838.677675] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb17e97-294b-48a1-8190-f1f245d57be6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.679031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb17e97-294b-48a1-8190-f1f245d57be6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.679031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb17e97-294b-48a1-8190-f1f245d57be6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.679031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb17e97-294b-48a1-8190-f1f245d57be6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.679031] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb17e97-294b-48a1-8190-f1f245d57be6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.110899] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.111138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.111247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.111486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.111705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.111864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 839.146067] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.146295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.146295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.146516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.146742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.159377] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 839.180939] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbb17e97-294b-48a1-8190-f1f245d57be6 [ 839.181191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.181361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.181411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.181612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.182136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.182254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbb17e97-294b-48a1-8190-f1f245d57be6 already deleted. [ 839.182345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb17e97-294b-48a1-8190-f1f245d57be6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.172998] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 841.173799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.174015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.175023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.175023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.175320] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.175320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.175320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.175424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.175456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.175539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.175603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.175762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.175831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.175907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.175993] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.679529] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bef7c22-495d-4b65-b8bf-57eb4115026b: rpc.has_security_group_logging(os_id): False [ 841.700805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.700960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.701030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.701255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.701620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.701869] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.701976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.702079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.702232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.702350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.702837] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.702837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.702837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.702837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.703365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.703365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.703365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.703365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.703581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.703581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.703581] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 841.775500] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.775713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.775787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.776009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.776396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.794678] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 842.984040] env[65511]: INFO networking_nsxv3.common.synchronization [req-e708e1cb-7a3b-444d-8ca6-f6576c32c728 req-76de336a-8558-40a9-b4e4-72cf0bd14ddd tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 842.984706] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 842.985083] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.985280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.985487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.985893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.986139] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.986282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.986374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.986557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.986759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.986893] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.368757] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.368963] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.369084] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.369367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.369624] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.369814] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.369875] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.370362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.370533] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.370746] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.370858] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.370959] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.371320] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.371320] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.371320] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.371497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.409959] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.410216] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.410388] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.410626] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.411061] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.411261] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.411397] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.411779] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.411947] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2339e8-0b1b-427e-8971-1fb4440e9aa0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.490740] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.490740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.490740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.490740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.491113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.491166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.491333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.491417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.491605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.491701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.491794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 already deleted. [ 843.491867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.809665] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 843.810016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.810317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.810641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.810776] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.914743] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.914743] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.914743] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.915052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.915207] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.915367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 not found, creating... [ 843.915663] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.915830] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.915907] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.916147] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.916281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.916562] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.916803] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.916910] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.917125] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.917272] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.917407] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 is going to be created. [ 843.943186] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.945023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.945023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.945023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.945023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.945727] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.315835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.316334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.316334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.316334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.316495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.316560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.316690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.316922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.317017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.317156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.317272] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.676474] env[65511]: INFO networking_nsxv3.common.synchronization [req-e708e1cb-7a3b-444d-8ca6-f6576c32c728 req-9bf3e541-5218-4ab3-97e0-8d1ec565f426 service nova] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 844.676776] env[65511]: INFO networking_nsxv3.common.synchronization [req-e708e1cb-7a3b-444d-8ca6-f6576c32c728 req-9bf3e541-5218-4ab3-97e0-8d1ec565f426 service nova] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 844.677455] env[65511]: INFO networking_nsxv3.common.synchronization [req-e708e1cb-7a3b-444d-8ca6-f6576c32c728 req-9bf3e541-5218-4ab3-97e0-8d1ec565f426 service nova] Enqueued Resource ID: 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 with Priority: HIGHEST for action port [ 844.677567] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_rules [ 844.677819] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 844.677869] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 with Priority: HIGHEST for action port [ 844.678196] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.678360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.678478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.678640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.678766] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.679805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.679946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.680080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.681096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.681096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.681096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.681096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.681096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.681096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.681096] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.684209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.684591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.684674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.684831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.685623] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2339e8-0b1b-427e-8971-1fb4440e9aa0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.819323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.819484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.819555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.819783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.820008] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.820161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.820226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.820465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.820583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.820657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.820814] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.820910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.820986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821311] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.821399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.821459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821926] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.191336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.191336] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.191336] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 with status ACTIVE [ 845.191336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.191336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.191336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.191903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.191903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.191903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.192150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.192348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.192534] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e2339e8-0b1b-427e-8971-1fb4440e9aa0 is going to be updated. [ 845.214802] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.214953] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.215025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.215772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.215772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.215897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e2339e8-0b1b-427e-8971-1fb4440e9aa0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.324349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bef7c22-495d-4b65-b8bf-57eb4115026b: rpc.has_security_group_logging(os_id): False [ 845.350706] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.350706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.350706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.350706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.350706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.350930] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.351081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.351081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.351234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.351311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.351757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.351857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.351912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.352074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.352155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.352328] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.352414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.352474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.352948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.353067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.353269] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 845.454230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.456369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.457111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.458760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.459398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.482050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 845.696891] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.199221] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.199221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.199221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.199388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.199388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.199841] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 is going to be created. [ 846.239041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.239263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.239325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.239505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.239657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.250636] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: UNINITIALIZED for 2s [ 847.498729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 847.499044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.261510] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: SUCCESS [ 848.261765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.261951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.262200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.262409] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.262528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.262593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.262781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.262869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.262971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.263055] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.765804] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.268993] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a14e9010-f590-466d-8c69-6b5bba0f38f8: rpc.has_security_group_logging(os_id): False [ 849.296027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.296027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.296027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.296535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.296535] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 is going to be created. [ 849.376836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.377383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.377582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.378080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.378375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.394394] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: IN_PROGRESS for 2s [ 849.678568] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 849.678690] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 850.347665] env[65511]: INFO networking_nsxv3.common.synchronization [req-aca710f2-ef9b-46f4-9e49-b2ac728230d4 req-68deb6dc-9986-4747-a850-0e3680d4366c tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 850.348642] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 850.349604] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.349757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.349831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.350160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.350530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.350689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.350800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.351092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.351572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.351572] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.600392] env[65511]: INFO networking_nsxv3.common.synchronization [req-1d61dfc6-dddc-4aa1-b8be-c1fb3fe9b8c4 req-e56357ce-bf09-42ff-89ba-9139540e5ed6 tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 850.600392] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 850.600392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.600392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.600579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.600697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.600797] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.600918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.600968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.601306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.601474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.601622] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.854743] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.104902] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.358455] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.411458] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: SUCCESS [ 851.411458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.607917] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.862635] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.862959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.862959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.864691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.864691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.864691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 851.912036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.912036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.912036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.912364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.912507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.925293] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 852.113763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.114508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.114508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.114711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.114917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.115124] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 852.137187] env[65511]: INFO networking_nsxv3.common.synchronization [req-dbdcf2a5-25a5-425b-a12f-5243417d374b req-459af7d2-68d9-40b9-8a07-2e5a86a4df63 tempest-ServersWithSpecificFlavorTestJSON-981424 tempest-ServersWithSpecificFlavorTestJSON-981424-project-member] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 852.137522] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGHEST for action security_group_members [ 852.138687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.138687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.138687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.139100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.139100] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.154271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.154271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.154271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.154271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.154271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.165989] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 852.641301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.641599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.641599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.641777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.673210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.673534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.673671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.673784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.674055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.674621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.674780] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be updated. [ 852.708382] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.708777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.708777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.709026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.709213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.722055] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: IN_PROGRESS for 2s [ 853.936832] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 853.937148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.176885] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 854.176885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.533628] env[65511]: INFO networking_nsxv3.common.synchronization [req-f2ee4489-f0a4-4deb-8de0-55c200a0fb67 req-e892ece9-71fe-4607-ab8d-c3bb9929445f tempest-ListImageFiltersTestJSON-1712442466 tempest-ListImageFiltersTestJSON-1712442466-project-member] Enqueued Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 854.534310] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 with Priority: HIGHEST for action security_group_members [ 854.534684] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc42862b-f71b-41f8-ad04-30546bed9ee5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.534870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.534985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.535295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.535379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.535496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.535558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.535795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.535902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.535997] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc42862b-f71b-41f8-ad04-30546bed9ee5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.736144] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 in Status: SUCCESS [ 854.736553] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 deletion is rescheduled due to dependency. [ 854.736553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.038604] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.038894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.038894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.039159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.059767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.060155] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.060155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.060439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.060439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.060568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.060640] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 is going to be updated. [ 855.089305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.089458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.089532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.089741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.089891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.099587] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: IN_PROGRESS for 2s [ 855.837274] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d3c1be11-b209-4fdb-8df1-b9e4f4948f33 None None] Enqueued Resource ID: 57fed682-2d87-4476-9007-a387d33ab68e with Priority: HIGHEST for action port [ 855.837926] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fed682-2d87-4476-9007-a387d33ab68e with Priority: HIGHEST for action port [ 855.838282] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-57fed682-2d87-4476-9007-a387d33ab68e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.838414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57fed682-2d87-4476-9007-a387d33ab68e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.838490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57fed682-2d87-4476-9007-a387d33ab68e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.838768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57fed682-2d87-4476-9007-a387d33ab68e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.838879] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fed682-2d87-4476-9007-a387d33ab68e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.342613] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57fed682-2d87-4476-9007-a387d33ab68e [ 856.343833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.344067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.344067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.344291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.344382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.344487] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57fed682-2d87-4476-9007-a387d33ab68e already deleted. [ 856.344582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57fed682-2d87-4476-9007-a387d33ab68e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.111626] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 in Status: SUCCESS [ 857.111834] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc42862b-f71b-41f8-ad04-30546bed9ee5 deletion is rescheduled due to dependency. [ 857.112065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc42862b-f71b-41f8-ad04-30546bed9ee5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.462624] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d629ddaf-78df-4460-9a33-850aaa44b3c0 None None] Enqueued Resource ID: e88adc34-ae25-421e-8498-717050a22f84 with Priority: HIGHEST for action port [ 858.463467] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88adc34-ae25-421e-8498-717050a22f84 with Priority: HIGHEST for action port [ 858.466995] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e88adc34-ae25-421e-8498-717050a22f84 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.467295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e88adc34-ae25-421e-8498-717050a22f84" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.467295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e88adc34-ae25-421e-8498-717050a22f84" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.467609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e88adc34-ae25-421e-8498-717050a22f84" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.467664] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e88adc34-ae25-421e-8498-717050a22f84',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.976313] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e88adc34-ae25-421e-8498-717050a22f84 [ 858.977717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.977717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.977717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.977717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.977717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.977717] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e88adc34-ae25-421e-8498-717050a22f84 already deleted. [ 858.977717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e88adc34-ae25-421e-8498-717050a22f84" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.527824] env[65511]: INFO networking_nsxv3.common.synchronization [req-441ba12a-0eae-4698-856c-6a912c99ddd5 req-80f0ef91-4daf-47d5-b68c-f55144c5bc81 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 859.529061] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 859.529835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.532278] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.532278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.532278] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.033694] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.033875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.033965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.034595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.034595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.034595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.034595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.034895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.034895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.034895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.034895] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be updated. [ 860.066333] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.066617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.066745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.066991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.067233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.080428] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: IN_PROGRESS for 2s [ 862.115487] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 862.115869] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e deletion is rescheduled due to dependency. [ 862.115869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.393728] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d6be990-374f-4382-8445-d64af37122be req-7f8ee0f7-0ed0-4e44-9838-6171464fb73a tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 863.394038] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d6be990-374f-4382-8445-d64af37122be req-7f8ee0f7-0ed0-4e44-9838-6171464fb73a tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 863.395246] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d6be990-374f-4382-8445-d64af37122be req-7f8ee0f7-0ed0-4e44-9838-6171464fb73a tempest-SecurityGroupsTestJSON-985914431 tempest-SecurityGroupsTestJSON-985914431-project-member] Enqueued Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 863.395362] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGHEST for action security_group_members [ 863.395542] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0211564f-7b41-42e2-85dc-08114fde7981 with Priority: HIGHEST for action security_group_members [ 863.395712] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c with Priority: HIGHEST for action security_group_members [ 863.396115] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.396318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.396409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.396749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.397354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.397647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.397647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.397932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.397932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.398060] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.399312] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0211564f-7b41-42e2-85dc-08114fde7981 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.399312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.399312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.399575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.399727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.399849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.399978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.400160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.400213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.400794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0211564f-7b41-42e2-85dc-08114fde7981',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.401804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.401804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.401804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.401804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.401804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.402348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.402348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.402348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.402348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.402348] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0746379-de9c-4dc8-baf1-40ed27bd5a2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.904633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.905638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.905721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.906013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.907251] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.907391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.907590] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.907672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.926965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.927277] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.927399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.927488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.927662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.927743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.927851] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be updated. [ 863.928838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.929231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.954019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.954461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.954805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.954906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.955144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.955544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.955655] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 is going to be updated. [ 863.957789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.957919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.958014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.958277] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.958620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.958722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.959083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.959143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.959238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c is going to be updated. [ 863.961198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.961198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.961313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.961435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.961545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.970565] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: IN_PROGRESS for 2s [ 863.991130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.991587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.991587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.991587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.991806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.994494] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.994635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.994703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.994889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.995100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.008450] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: IN_PROGRESS for 2s [ 864.009178] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: IN_PROGRESS for 2s [ 865.980984] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2226f194-d814-4c64-80d7-5b7c97e1019e in Status: SUCCESS [ 865.981284] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e deletion is rescheduled due to dependency. [ 865.981329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.024202] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0211564f-7b41-42e2-85dc-08114fde7981 in Status: SUCCESS [ 866.024384] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0211564f-7b41-42e2-85dc-08114fde7981 deletion is rescheduled due to dependency. [ 866.024501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0211564f-7b41-42e2-85dc-08114fde7981" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.025513] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c in Status: SUCCESS [ 866.025513] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0746379-de9c-4dc8-baf1-40ed27bd5a2c deletion is rescheduled due to dependency. [ 866.025513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0746379-de9c-4dc8-baf1-40ed27bd5a2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.163132] env[65511]: INFO networking_nsxv3.common.synchronization [req-837f3800-6cbb-47b8-93a7-c47db233a918 req-39147111-fdc7-47b3-8cf2-9276c964e6d6 tempest-ServersTestBootFromVolume-1594891053 tempest-ServersTestBootFromVolume-1594891053-project-member] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 866.163132] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 866.163132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.163132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.163132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.163132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.163132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.163132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.164121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.164483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.164671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.164854] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.245247] env[65511]: INFO networking_nsxv3.common.synchronization [req-0e1ccd44-56dc-4a06-8592-919aa91203b6 req-ef002055-73a6-4a36-9522-3d2abbaca163 tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 866.247051] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 866.247051] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.247051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.247051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.249536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.249536] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.249536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.249536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.249536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.249536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.249536] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.497210] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.497210] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-644" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.497210] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-644" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.497431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-644" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.497563] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.497728] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.497893] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.498108] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.498262] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.498464] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.498570] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.498670] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.498770] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.498872] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.498970] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.499284] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.519398] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.519562] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.519695] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.519867] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-644" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.520197] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-ee486119-8706-48e6-9fd9-4028b7b00c93 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.520361] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.520473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.520781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.520916] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee486119-8706-48e6-9fd9-4028b7b00c93',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.667726] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.667946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.668050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.668261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.668350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.668607] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.668742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.668829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.669023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.669132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.669256] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d already deleted. [ 866.669335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.750734] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.024025] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.024342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.024399] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.024668] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.024789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.024946] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port ee486119-8706-48e6-9fd9-4028b7b00c93 not found, creating... [ 867.025217] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.025366] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.025473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.025731] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.025836] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.026142] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.026286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.026394] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.026672] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.026801] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.026935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: ee486119-8706-48e6-9fd9-4028b7b00c93 is going to be created. [ 867.048226] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.048432] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.048560] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.050052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.050052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.050052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.253300] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.756113] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.756318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.756318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.756958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.756958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.756958] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be updated. [ 867.761672] env[65511]: INFO networking_nsxv3.common.synchronization [req-837f3800-6cbb-47b8-93a7-c47db233a918 req-a965571c-5c6b-48db-80d1-9b0a7d1deadc service nova] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 867.761846] env[65511]: INFO networking_nsxv3.common.synchronization [req-837f3800-6cbb-47b8-93a7-c47db233a918 req-a965571c-5c6b-48db-80d1-9b0a7d1deadc service nova] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 867.761979] env[65511]: INFO networking_nsxv3.common.synchronization [req-837f3800-6cbb-47b8-93a7-c47db233a918 req-a965571c-5c6b-48db-80d1-9b0a7d1deadc service nova] Enqueued Resource ID: ee486119-8706-48e6-9fd9-4028b7b00c93 with Priority: HIGHEST for action port [ 867.762220] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_rules [ 867.762352] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 867.762446] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee486119-8706-48e6-9fd9-4028b7b00c93 with Priority: HIGHEST for action port [ 867.763017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.763146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.763212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.763393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.763463] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.764371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.764506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.764576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.764747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.764900] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.764995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.765225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.765225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.765358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.765358] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.766735] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee486119-8706-48e6-9fd9-4028b7b00c93 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.766735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.766735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.766735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.767080] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee486119-8706-48e6-9fd9-4028b7b00c93',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.784046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.784187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.784262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.784465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.784599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.796407] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 868.268306] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.268592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.268685] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee486119-8706-48e6-9fd9-4028b7b00c93 with status ACTIVE [ 868.268774] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.268883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.268948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.269177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.269281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.269445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.269618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.269618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.269764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.269812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.269987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.270091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.270143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.270282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.270353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.270436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee486119-8706-48e6-9fd9-4028b7b00c93 is going to be updated. [ 868.271533] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.312021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.312286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.312286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.312455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.312590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.312751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee486119-8706-48e6-9fd9-4028b7b00c93" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.774551] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.280557] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.280890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.280890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.280987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.281592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.281592] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d is going to be created. [ 869.306956] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.307145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.307193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.307406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.307569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.318772] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: UNINITIALIZED for 2s [ 869.806540] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 869.806540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.994550] env[65511]: INFO networking_nsxv3.common.synchronization [req-74ed7996-4cdd-48da-9e9a-de621f38caa8 req-d1ce1fbf-f80c-4a74-a6ed-fdc0643981b3 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 870.995191] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 870.995568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.995695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.995787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.996068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.996237] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.996340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.996398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.996845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.996845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.996845] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.321190] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.321411] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.321532] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.321806] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.322076] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.322229] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.322339] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.322657] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.322817] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.323035] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.323144] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.323260] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.323344] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.323548] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.323634] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.323764] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.337112] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: SUCCESS [ 871.337538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.337715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.337942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.339147] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.339147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.339147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.339147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.339147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.339147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.339147] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.353061] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.353283] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.353283] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.353447] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.354114] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-c344ec3b-3adf-4f33-8a2c-970c757e6378 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.354114] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.354114] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.355375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.355375] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c344ec3b-3adf-4f33-8a2c-970c757e6378',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.500686] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.500923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.501011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.503188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.503188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.503188] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be deleted. [ 871.534860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.535055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.535055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.535248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.535336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.535429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.843176] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.861608] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.861831] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.862185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.862265] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.862407] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.862581] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port c344ec3b-3adf-4f33-8a2c-970c757e6378 not found, creating... [ 871.862808] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.863017] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.863168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.863391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.863580] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.863901] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.864071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.864205] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.864393] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.864516] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.864648] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: c344ec3b-3adf-4f33-8a2c-970c757e6378 is going to be created. [ 871.887693] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.887907] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.888028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.888403] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.888638] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.888865] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.345923] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93ea4ead-0c30-430c-9c90-be02d8f74d6d: rpc.has_security_group_logging(os_id): False [ 872.366065] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.366288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.366288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.366520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.366608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.366873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.367097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.367097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.367221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.367353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.367536] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d is going to be created. [ 872.441135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.441135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.441135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.441135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.441135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.450687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: IN_PROGRESS for 2s [ 872.616601] env[65511]: INFO networking_nsxv3.common.synchronization [req-74ed7996-4cdd-48da-9e9a-de621f38caa8 req-d0cd3873-5596-475f-9a97-9900a7055268 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 872.616601] env[65511]: INFO networking_nsxv3.common.synchronization [req-74ed7996-4cdd-48da-9e9a-de621f38caa8 req-d0cd3873-5596-475f-9a97-9900a7055268 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 872.618046] env[65511]: INFO networking_nsxv3.common.synchronization [req-74ed7996-4cdd-48da-9e9a-de621f38caa8 req-d0cd3873-5596-475f-9a97-9900a7055268 service nova] Enqueued Resource ID: c344ec3b-3adf-4f33-8a2c-970c757e6378 with Priority: HIGHEST for action port [ 872.618046] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 872.618046] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 872.618703] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c344ec3b-3adf-4f33-8a2c-970c757e6378 with Priority: HIGHEST for action port [ 872.618703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.618703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.618703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.618876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.618876] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.622490] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.622490] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.622490] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.622490] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c344ec3b-3adf-4f33-8a2c-970c757e6378 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.622490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.622490] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c344ec3b-3adf-4f33-8a2c-970c757e6378',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.124481] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.124634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.124764] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.125590] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c344ec3b-3adf-4f33-8a2c-970c757e6378 with status ACTIVE [ 873.125768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.125936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.125996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.126216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.126299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.126467] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.126563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.126625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.126773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.126859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.127459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.127599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.127666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.127820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.127897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.127985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c344ec3b-3adf-4f33-8a2c-970c757e6378 is going to be updated. [ 873.152801] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.153017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.153087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.153282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.153424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.153612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c344ec3b-3adf-4f33-8a2c-970c757e6378" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.629515] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.132456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.132596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.132596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.132787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.132875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.132995] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 874.159151] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.159295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.159367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.159585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.159747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.172351] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: UNINITIALIZED for 2s [ 874.462858] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: SUCCESS [ 874.462858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.850886] env[65511]: INFO networking_nsxv3.common.synchronization [req-31079dc3-2d5e-4fc1-89a9-ef6ae479ff5d req-3607d41f-215d-4f9f-b8a8-223130cf723c tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 875.852036] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 875.852036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.852036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.852246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.852283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.852423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.852516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.852574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.852735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.852818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.852910] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.181835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 876.182093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.182282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.182511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.182708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.182825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.182891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.183066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.183145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.183229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.183320] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.206338] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.206705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.206705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.206960] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.207344] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.207503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.207617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.207845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.207983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.208420] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.208420] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.208499] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.208535] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.208635] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.208838] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.209026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.229624] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.229788] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.229940] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.230147] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.230471] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.230651] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.230785] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.231076] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.231214] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff890e1f-d0c8-4122-a196-c228bdc3ff5c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.355094] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.355252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.355303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.355511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.355597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.355789] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.355918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.355982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.356149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.356221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.356309] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 876.385275] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.385422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.385481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.385695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.385893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.396304] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 876.685298] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.685538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.685538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.685839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.685962] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.686111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.686235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.686302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.686402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.686508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.686722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.686865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.687013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.687180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.687384] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.687514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.687587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.687779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.687913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.688251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.688251] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.734315] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.734747] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.734909] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.735296] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.735494] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.735678] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port ff890e1f-d0c8-4122-a196-c228bdc3ff5c not found, creating... [ 876.736067] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.736266] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.736393] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.736657] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.736839] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.737231] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.737450] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.737639] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.737911] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.738133] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.738292] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: ff890e1f-d0c8-4122-a196-c228bdc3ff5c is going to be created. [ 876.763656] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.764032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.764174] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.764497] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.764969] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.765279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.191048] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 877.209166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.209349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.209422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.209626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.209728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.209904] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.210034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.210104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.210323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.210323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.210501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.210685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.210746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.210888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.210956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.211160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.211258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.211318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.211440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.211504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.211647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 877.268153] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.268396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.268396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.268552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.268755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.301601] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 877.331926] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0d7faa5b-e681-4f0e-9a07-f1a368ae0d79 None None] Enqueued Resource ID: 42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355 with Priority: HIGHEST for action port [ 877.332702] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355 with Priority: HIGHEST for action port [ 877.333370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.333501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.333569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.333877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.333977] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [req-31079dc3-2d5e-4fc1-89a9-ef6ae479ff5d req-e3440bc4-b86a-411a-8f7f-752b6d8a7fa4 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [req-31079dc3-2d5e-4fc1-89a9-ef6ae479ff5d req-e3440bc4-b86a-411a-8f7f-752b6d8a7fa4 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [req-31079dc3-2d5e-4fc1-89a9-ef6ae479ff5d req-e3440bc4-b86a-411a-8f7f-752b6d8a7fa4 service nova] Enqueued Resource ID: ff890e1f-d0c8-4122-a196-c228bdc3ff5c with Priority: HIGHEST for action port [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 877.512045] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff890e1f-d0c8-4122-a196-c228bdc3ff5c with Priority: HIGHEST for action port [ 877.512045] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.512045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.512045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.512840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.512840] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.513521] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.513521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.513625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.513725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.513777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.514024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.514077] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff890e1f-d0c8-4122-a196-c228bdc3ff5c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.836791] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355 [ 877.836791] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.836791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.837137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.837295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.837295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.837389] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355 already deleted. [ 877.837465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42b5bb50-4ad9-4b2f-b1a4-e8c9924ab355" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.017252] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.017471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.018139] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff890e1f-d0c8-4122-a196-c228bdc3ff5c with status ACTIVE [ 878.018574] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.018799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.018895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.019616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.019616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.019616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.020787] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.020787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.020787] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff890e1f-d0c8-4122-a196-c228bdc3ff5c is going to be updated. [ 878.045765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.045936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.046052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.046234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.046375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.046536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff890e1f-d0c8-4122-a196-c228bdc3ff5c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.406455] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 878.406739] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 878.406739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.408987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.408987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.408987] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.912249] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.030820] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d183feea-215f-4fd2-ae47-e3bd9e7a8212 tempest-ServersTestJSON-2089008876 tempest-ServersTestJSON-2089008876-project-member] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 879.031381] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 879.031700] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.031788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.031857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.035938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.036102] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.290644] env[65511]: INFO networking_nsxv3.common.synchronization [None req-aae65a60-02e7-455c-909a-e52ee802d372 tempest-ServersTestJSON-2089008876 tempest-ServersTestJSON-2089008876-project-member] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 879.291276] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 879.291607] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.292927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.317882] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 879.318241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.418163] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.556812] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.557084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.557084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.557264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.557356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.557452] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 already deleted. [ 879.557637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.557737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.557875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.557914] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.631607] env[65511]: INFO networking_nsxv3.common.synchronization [req-d289c1e2-eee6-4a4d-9ad1-88eda64ea019 req-6c8792a6-627a-4b69-8503-1d1112004a8b tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 879.632208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 879.632434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.632556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.632629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.634119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.634307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.634421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.634488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.634664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.634753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.634851] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.664592] env[65511]: INFO networking_nsxv3.common.synchronization [req-d289c1e2-eee6-4a4d-9ad1-88eda64ea019 req-6c8792a6-627a-4b69-8503-1d1112004a8b tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 879.664757] env[65511]: INFO networking_nsxv3.common.synchronization [req-d289c1e2-eee6-4a4d-9ad1-88eda64ea019 req-6c8792a6-627a-4b69-8503-1d1112004a8b tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 879.664893] env[65511]: INFO networking_nsxv3.common.synchronization [req-d289c1e2-eee6-4a4d-9ad1-88eda64ea019 req-6c8792a6-627a-4b69-8503-1d1112004a8b tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 879.665460] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 879.665578] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 879.665672] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 879.666140] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.666262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.666325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.666599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.666656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.667895] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.668023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.668795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eecba92-4225-45a2-b8d6-965a5cb96bdc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.668939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.669047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.669304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.669427] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecba92-4225-45a2-b8d6-965a5cb96bdc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.919586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.919748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.919813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.920053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.920148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.920251] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 879.940883] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ab7ff835-af00-4c83-94c8-94fb880a9b8b None None] Enqueued Resource ID: d5c7a1bf-d35d-4307-90e6-5bb1954477c0 with Priority: HIGHEST for action port [ 879.941428] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5c7a1bf-d35d-4307-90e6-5bb1954477c0 with Priority: HIGHEST for action port [ 879.941726] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5c7a1bf-d35d-4307-90e6-5bb1954477c0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.941844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5c7a1bf-d35d-4307-90e6-5bb1954477c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.941908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5c7a1bf-d35d-4307-90e6-5bb1954477c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.942287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5c7a1bf-d35d-4307-90e6-5bb1954477c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.942396] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c7a1bf-d35d-4307-90e6-5bb1954477c0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.951529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.951657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.951753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.952038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.952176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.962391] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 880.080102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.080306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.080306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.080534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.080624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.080718] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 already deleted. [ 880.080801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.137398] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.171945] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.172175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.172300] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eecba92-4225-45a2-b8d6-965a5cb96bdc with status ACTIVE [ 880.172477] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.172582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.173423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.173423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.173423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.173423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.173640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.173640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.173705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.173971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.174173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.174290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.174351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.174485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.174926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.175017] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc is going to be updated. [ 880.211289] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.211430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.211499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.211708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.211860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.212032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.445016] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5c7a1bf-d35d-4307-90e6-5bb1954477c0 [ 880.445719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.448412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.448412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.448412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.448412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.448412] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5c7a1bf-d35d-4307-90e6-5bb1954477c0 already deleted. [ 880.448412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5c7a1bf-d35d-4307-90e6-5bb1954477c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.639796] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.059428] env[65511]: INFO networking_nsxv3.common.synchronization [req-a733c9f8-e829-40e1-9fd5-003a11857da3 req-0b0b2b12-8971-4282-8a5e-88484f4b3778 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 881.059428] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 881.059428] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.059844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.060053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.060412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.061322] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.061688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.061879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.062735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.062735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.062735] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.142416] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.142584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.142643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.142845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.142943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.143029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 881.176931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.177138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.177204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.177426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.177714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.189580] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 881.495808] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.496177] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.496327] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.496731] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.497210] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.497480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.497570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.497743] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.497885] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.498101] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.498210] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.498328] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.498428] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.498574] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.498615] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.498740] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.518465] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.518654] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.518864] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.518964] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.519310] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.519482] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.519600] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.519950] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.520098] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc55ae9-e64a-4b16-b4e0-f487012ed8b4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.565955] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.566215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.566313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.566556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.566701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.566998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.567146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.567241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.567421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.567544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.567697] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a already deleted. [ 881.567754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.973167] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 881.973383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.973588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.973918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.974101] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.974224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.974285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.974449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.974528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.974613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.974703] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.025470] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.025470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.025622] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.026425] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.027029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.027029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 not found, creating... [ 882.027171] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.027252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.027339] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.027570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.027698] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.028124] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.028316] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.028430] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.028636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.028763] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.029079] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 is going to be created. [ 882.049897] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.050185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.050372] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.050482] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.050718] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.050938] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.477535] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.477709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.477778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.478065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.478282] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.478480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.478564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.478753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.478841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.478935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.479146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.479241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.479299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.479455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.479593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.479681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.479735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.479875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.479952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.480115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.480235] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.753045] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9c0e14ff-e989-4e1c-921c-05c01f15a15d tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 882.754430] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 882.754927] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.755123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.755282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.755588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.755714] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.780029] env[65511]: INFO networking_nsxv3.common.synchronization [req-a733c9f8-e829-40e1-9fd5-003a11857da3 req-beaca9eb-7455-4759-bfc5-352248ba231c service nova] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 882.780194] env[65511]: INFO networking_nsxv3.common.synchronization [req-a733c9f8-e829-40e1-9fd5-003a11857da3 req-beaca9eb-7455-4759-bfc5-352248ba231c service nova] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 882.780316] env[65511]: INFO networking_nsxv3.common.synchronization [req-a733c9f8-e829-40e1-9fd5-003a11857da3 req-beaca9eb-7455-4759-bfc5-352248ba231c service nova] Enqueued Resource ID: 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 with Priority: HIGHEST for action port [ 882.780867] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_rules [ 882.781098] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 882.781200] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 with Priority: HIGHEST for action port [ 882.782082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.782257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.782354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.782583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.782834] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.783769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.783769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.783873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.784047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.784202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.784298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.784357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.784503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.786111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.786111] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.786111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.786111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.786111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.786884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.786884] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cc55ae9-e64a-4b16-b4e0-f487012ed8b4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.888261] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9e18b965-1e61-4b45-a6b1-0f48b65c7114 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 882.889293] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 882.889366] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.889446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.982936] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 883.004107] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.004292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.004441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.004632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.004715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.005016] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.005112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.005168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.005384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.005471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.005688] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.005776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.005832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.006011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.006880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.007116] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.007225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.007285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.007416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.007527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.007576] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 883.075432] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.075432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.075616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.075712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.075833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.095240] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 883.207078] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 883.207381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.207582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.207866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.208043] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.208195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.208282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.208745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.208859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.208963] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.281928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.282096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.282165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.282810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.282916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.282992] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 already deleted. [ 883.283096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.283305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.283436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.283521] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.288457] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.289990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.290132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.290520] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 with status ACTIVE [ 883.290697] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.290805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.290868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.291102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.291247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.291487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.291636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.292265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.292515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.292609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.292816] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.292920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.292987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.293183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.293260] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.293353] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cc55ae9-e64a-4b16-b4e0-f487012ed8b4 is going to be updated. [ 883.331737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.331737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.331737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.331927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.332063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.332223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cc55ae9-e64a-4b16-b4e0-f487012ed8b4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.714972] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.791311] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.807077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.807273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.807729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.807729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.807922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.808036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 already deleted. [ 883.808173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.217859] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.294664] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.295225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.295225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.295610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.295842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.296038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a is going to be created. [ 884.335707] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.335863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.336159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.336273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.336412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.347073] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: UNINITIALIZED for 2s [ 884.723387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.723539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.723539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.723867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.723867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.725688] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 884.759444] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.759692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.759879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.760103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.760228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.773166] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 884.891896] env[65511]: INFO networking_nsxv3.common.synchronization [req-de72a86b-e599-4ce3-a239-13ec39c19a4b req-328ef52b-57a8-4dbf-9c7b-d2044390e124 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 884.892538] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 884.892872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.892999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.915059] env[65511]: INFO networking_nsxv3.common.synchronization [req-de72a86b-e599-4ce3-a239-13ec39c19a4b req-328ef52b-57a8-4dbf-9c7b-d2044390e124 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 884.915059] env[65511]: INFO networking_nsxv3.common.synchronization [req-de72a86b-e599-4ce3-a239-13ec39c19a4b req-328ef52b-57a8-4dbf-9c7b-d2044390e124 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 884.915059] env[65511]: INFO networking_nsxv3.common.synchronization [req-de72a86b-e599-4ce3-a239-13ec39c19a4b req-328ef52b-57a8-4dbf-9c7b-d2044390e124 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 884.915509] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_rules [ 884.915633] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 884.916061] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc with Priority: HIGHEST for action port [ 884.917822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.917822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.917822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.917822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.917822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eecba92-4225-45a2-b8d6-965a5cb96bdc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.917822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.918259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.918259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.918259] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eecba92-4225-45a2-b8d6-965a5cb96bdc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.112946] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 885.113071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.420871] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7eecba92-4225-45a2-b8d6-965a5cb96bdc with status ACTIVE [ 885.421149] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.421288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.421355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.421652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.421741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.421958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.422077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.422135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.422374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.422669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.422752] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.422853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.422916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.423073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.423148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.423232] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7eecba92-4225-45a2-b8d6-965a5cb96bdc is going to be updated. [ 885.461447] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.461652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.461652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.461876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.462717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.462717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eecba92-4225-45a2-b8d6-965a5cb96bdc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.059055] env[65511]: INFO networking_nsxv3.common.synchronization [req-4677b7b3-29cb-4e4c-a2c5-518d94e284c3 req-7c0cce7d-7d70-4281-a633-9beb645811c0 tempest-ServerAddressesTestJSON-877455753 tempest-ServerAddressesTestJSON-877455753-project-member] Enqueued Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 886.059660] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 886.059986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.060132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.060193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.060466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.060625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.060722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.060790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.060957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.061051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.061150] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.358656] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: SUCCESS [ 886.358877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.359083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.359353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.359599] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.359727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.359792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.360045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.360045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.360197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.360255] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.528070] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.528070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-559" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.528070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-559" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.528070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-559" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.528070] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.528070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.528070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.528725] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.528917] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.529140] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.529244] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.529342] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.529440] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.529536] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.529631] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.529752] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.552889] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.553371] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.553610] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.554632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-559" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.554632] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-a0f4a745-a1cc-4e64-a946-dff248c98bfb taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.554632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.554632] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.555087] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.555249] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f4a745-a1cc-4e64-a946-dff248c98bfb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.564450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.564636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.564712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.564914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.565019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.565346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.565456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.565514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.565683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.565896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.565896] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 already deleted. [ 886.566131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.786235] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 886.786441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.786631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.786848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.787082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.787217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.787316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.787446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.787526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.787613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.787737] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.788717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.788899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.789131] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.789249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.789314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.789453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.789527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.789632] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.863733] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.057869] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058096] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058371] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.058692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.058879] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.059224] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port a0f4a745-a1cc-4e64-a946-dff248c98bfb not found, creating... [ 887.059487] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.059576] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.059690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.059904] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.060205] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.060335] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.060485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.060595] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.060792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.060918] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.061231] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: a0f4a745-a1cc-4e64-a946-dff248c98bfb is going to be created. [ 887.080714] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.081997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.081997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.082304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.082545] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.082806] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.291629] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.295070] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.366401] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479f3d06-9c02-42eb-90b2-95e362b2945a: rpc.has_security_group_logging(os_id): False [ 887.385785] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.386051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.386051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.386256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.386344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.387749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.387888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.387946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.388159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.388298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.388441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a is going to be created. [ 887.453581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.454220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.454341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.454514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.454714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.466266] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: IN_PROGRESS for 2s [ 887.796059] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dd306dd-83f9-434d-a479-235e5cd1d98f: rpc.has_security_group_logging(os_id): False [ 887.797214] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.822232] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.822232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.822232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.822232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.844951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.845336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.845493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.845552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.845724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.845830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.845884] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 887.910826] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.910826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.910992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.911834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.911834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.923846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 887.944845] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c7a754b0-802a-44cb-8514-3c202dfc0409 None None] Enqueued Resource ID: 5f561458-1370-4e0e-9657-6bea3de12625 with Priority: HIGHEST for action port [ 887.945623] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f561458-1370-4e0e-9657-6bea3de12625 with Priority: HIGHEST for action port [ 887.946575] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f561458-1370-4e0e-9657-6bea3de12625 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.946575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f561458-1370-4e0e-9657-6bea3de12625" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.946575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f561458-1370-4e0e-9657-6bea3de12625" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.946575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f561458-1370-4e0e-9657-6bea3de12625" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.946575] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f561458-1370-4e0e-9657-6bea3de12625',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.976534] env[65511]: INFO networking_nsxv3.common.synchronization [req-4677b7b3-29cb-4e4c-a2c5-518d94e284c3 req-ce584af2-27de-4924-b669-cdf9907d94a2 service nova] Enqueued Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_rules [ 887.976701] env[65511]: INFO networking_nsxv3.common.synchronization [req-4677b7b3-29cb-4e4c-a2c5-518d94e284c3 req-ce584af2-27de-4924-b669-cdf9907d94a2 service nova] Enqueued Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 887.976834] env[65511]: INFO networking_nsxv3.common.synchronization [req-4677b7b3-29cb-4e4c-a2c5-518d94e284c3 req-ce584af2-27de-4924-b669-cdf9907d94a2 service nova] Enqueued Resource ID: a0f4a745-a1cc-4e64-a946-dff248c98bfb with Priority: HIGHEST for action port [ 887.977383] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_rules [ 887.977521] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 887.977714] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f4a745-a1cc-4e64-a946-dff248c98bfb with Priority: HIGHEST for action port [ 887.978050] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.978183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.978254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.978546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.978619] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.979756] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.980060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.980219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.980759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.980928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.981051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.981153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.981394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.981491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.981602] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.984018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f4a745-a1cc-4e64-a946-dff248c98bfb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.984220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.984289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.984451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.984528] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f4a745-a1cc-4e64-a946-dff248c98bfb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.299760] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.301728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.301728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.301728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.301728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.301728] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 888.342106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.342106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.342240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.345474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.345474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.353128] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 888.449470] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f561458-1370-4e0e-9657-6bea3de12625 [ 888.449692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.449829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.449890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.450122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.450206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.450300] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f561458-1370-4e0e-9657-6bea3de12625 already deleted. [ 888.450380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f561458-1370-4e0e-9657-6bea3de12625" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.484181] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.486168] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.486289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.487647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0f4a745-a1cc-4e64-a946-dff248c98bfb with status ACTIVE [ 888.487865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.487992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.488075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.488271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.488358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.488527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.488623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.488684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.488834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.488908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.489099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.489430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.489430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.489430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.489430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.489604] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0f4a745-a1cc-4e64-a946-dff248c98bfb is going to be updated. [ 888.515029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.515243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.515291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.515594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.515674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.515762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f4a745-a1cc-4e64-a946-dff248c98bfb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.992188] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.482202] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: SUCCESS [ 889.482202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.495848] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.495848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.495848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.495848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.496131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.496131] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 is going to be created. [ 889.524603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.524603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.524603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.524603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.524603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.534198] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: UNINITIALIZED for 2s [ 889.938695] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 889.939011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.939271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.939538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.939643] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.370035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.370035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.370035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.370035] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.445236] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.445236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.463947] env[65511]: INFO networking_nsxv3.common.synchronization [None req-70d634b0-9bcf-466b-b65a-94079272a55e None None] Enqueued Resource ID: c975af3c-8bd9-475e-a107-e3bf5d5ce634 with Priority: HIGHEST for action port [ 890.464970] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c975af3c-8bd9-475e-a107-e3bf5d5ce634 with Priority: HIGHEST for action port [ 890.465504] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c975af3c-8bd9-475e-a107-e3bf5d5ce634 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.465637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c975af3c-8bd9-475e-a107-e3bf5d5ce634" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.465704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c975af3c-8bd9-475e-a107-e3bf5d5ce634" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.465991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c975af3c-8bd9-475e-a107-e3bf5d5ce634" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.466085] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975af3c-8bd9-475e-a107-e3bf5d5ce634',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.874111] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.971023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c975af3c-8bd9-475e-a107-e3bf5d5ce634 [ 890.971250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.971377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.971442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.972421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.972421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.972421] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c975af3c-8bd9-475e-a107-e3bf5d5ce634 already deleted. [ 890.972421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c975af3c-8bd9-475e-a107-e3bf5d5ce634" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.108601] env[65511]: INFO networking_nsxv3.common.synchronization [req-548507cd-c4a2-456d-a83a-cae36016f58c req-0243bbbe-5613-41e0-8756-10f7bbb45c47 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 891.109989] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 891.109989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.109989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.109989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.109989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.110401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.110401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.110514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.110645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.110751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.110865] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.376918] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.502128] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.502269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.503027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.503027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.503027] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.503027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.503274] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.503407] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.503455] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.504030] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.504030] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.504030] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.504030] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.504251] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.505583] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.505766] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.528668] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.528919] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.529665] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.529960] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-997" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.530347] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-d00953a5-ab16-40a5-b8db-58f9c1e807b2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.530522] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.530639] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.531157] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.531376] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00953a5-ab16-40a5-b8db-58f9c1e807b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.545204] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: SUCCESS [ 891.545315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.545451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.546177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.546177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.546177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.546177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.546519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.546519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.546519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.547298] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.612688] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.612956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.613113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.613354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.613450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.613652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.613749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.613814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.613977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.614076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.614174] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be deleted. [ 891.643826] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.643826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.643826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.644403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.644403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.644403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.882579] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.882884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.882884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.883104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.883164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.883224] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 891.914925] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.915144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.915212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.915390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.915584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.924998] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 891.972280] env[65511]: INFO networking_nsxv3.common.synchronization [req-c30aa9df-32e3-4b83-9da5-6fa870f6b481 req-454d6337-3974-4f82-a19a-410fab22d220 tempest-AttachInterfacesUnderV243Test-2147158387 tempest-AttachInterfacesUnderV243Test-2147158387-project-member] Enqueued Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 891.973097] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f with Priority: HIGHEST for action security_group_members [ 891.973538] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1dd306dd-83f9-434d-a479-235e5cd1d98f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.973681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.033890] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.034130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.034253] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.034525] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.034764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.034919] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port d00953a5-ab16-40a5-b8db-58f9c1e807b2 not found, creating... [ 892.035208] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.035359] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.035470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.035685] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.035816] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.036141] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.036332] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.036480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.036688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.036818] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.036956] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: d00953a5-ab16-40a5-b8db-58f9c1e807b2 is going to be created. [ 892.048785] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.049030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.049030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.049198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.049358] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.049454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.049515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.049660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.049744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.050720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.050720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.050720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.051176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.051176] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.056707] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.056877] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.057018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.057237] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.057463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.057660] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.553483] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60d953b3-c8b1-4f58-8b03-316370f64a75: rpc.has_security_group_logging(os_id): False [ 892.575224] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.575423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.575547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.575711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.575928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.576269] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.576402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.576469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.577420] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.577420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.577879] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.577879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.577879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.577879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.578043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.578043] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 is going to be created. [ 892.648318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.648670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.648670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.648833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.649114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.672060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: IN_PROGRESS for 2s [ 892.911478] env[65511]: INFO networking_nsxv3.common.synchronization [req-548507cd-c4a2-456d-a83a-cae36016f58c req-80403c89-2d8e-4ddd-9541-407a8b62d527 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 892.915238] env[65511]: INFO networking_nsxv3.common.synchronization [req-548507cd-c4a2-456d-a83a-cae36016f58c req-80403c89-2d8e-4ddd-9541-407a8b62d527 service nova] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 892.915238] env[65511]: INFO networking_nsxv3.common.synchronization [req-548507cd-c4a2-456d-a83a-cae36016f58c req-80403c89-2d8e-4ddd-9541-407a8b62d527 service nova] Enqueued Resource ID: d00953a5-ab16-40a5-b8db-58f9c1e807b2 with Priority: HIGHEST for action port [ 892.915238] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_rules [ 892.915238] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 892.915238] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d00953a5-ab16-40a5-b8db-58f9c1e807b2 with Priority: HIGHEST for action port [ 892.915238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.915238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.915684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.915684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.915684] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.916654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.916766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.916809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.917741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.917741] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.917741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.918249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.918457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.918626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.918700] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.920434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d00953a5-ab16-40a5-b8db-58f9c1e807b2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.920434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.920434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.920697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.920697] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00953a5-ab16-40a5-b8db-58f9c1e807b2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.422644] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.422808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.422979] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.424268] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d00953a5-ab16-40a5-b8db-58f9c1e807b2 with status ACTIVE [ 893.424456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.424566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.424630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.424823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.424908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.425087] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.425180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.425238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.425386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.425460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.425631] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.425720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.426068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.426253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.426337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.426424] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d00953a5-ab16-40a5-b8db-58f9c1e807b2 is going to be updated. [ 893.450700] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.451199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.451760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.451760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.452426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.452672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d00953a5-ab16-40a5-b8db-58f9c1e807b2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.929048] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.936805] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 893.937335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.937913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.938212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.938463] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.938616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.938704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.938889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.938998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.939162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.939290] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.940124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.940342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.940546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.940687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.940780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.940952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.941074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.941196] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.432775] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.432939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.433016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.433237] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.433340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.433455] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be created. [ 894.445501] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1dd306dd-83f9-434d-a479-235e5cd1d98f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.446957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.446957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.446957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.447274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447579] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.447713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.447753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.448022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.448022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.448150] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 894.468632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.468796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.468872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.469130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.469367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.482426] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: UNINITIALIZED for 2s [ 894.489210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.490668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.490668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.490668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.490668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.500670] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 894.685788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: SUCCESS [ 894.686713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.950028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1dd306dd-83f9-434d-a479-235e5cd1d98f: rpc.has_security_group_logging(os_id): False [ 894.970905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.970905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.970905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.971188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.971188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.971379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.971477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.971524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.971710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.971793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.971900] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f is going to be updated. [ 895.065706] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.065706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.065706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.066122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.066122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.084090] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: IN_PROGRESS for 2s [ 895.930724] env[65511]: INFO networking_nsxv3.common.synchronization [req-63be1520-6a63-4458-af7d-570db37133d7 req-9ecc8163-3ea5-4379-8a1e-bc4657962239 tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 895.932869] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 895.933640] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.933902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.934023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.934609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.934915] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.935092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.935192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.935423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.935589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.935732] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.438737] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.497568] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 896.497803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.497999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.498513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.498513] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.498599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.498685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.498884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.499083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.499083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.499083] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.511121] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 896.511324] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f deletion is rescheduled due to dependency. [ 896.511452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.941578] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.004665] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.006130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.006130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.006610] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.006610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.006610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.006610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.006791] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.006791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.006791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.006922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.007055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.007474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.007571] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.010378] env[65511]: INFO networking_nsxv3.common.synchronization [req-c7bf0cfe-9b59-4289-aea8-f0089cdabbc3 req-a53eadd7-f5a2-4fe7-8162-f4fcccd6f9ce tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 897.010992] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 897.011337] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.011479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.011550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.011724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.011860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.011962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.012012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.012180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.012271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.012367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.103085] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1dd306dd-83f9-434d-a479-235e5cd1d98f in Status: SUCCESS [ 897.103395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dd306dd-83f9-434d-a479-235e5cd1d98f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.321028] env[65511]: INFO networking_nsxv3.common.synchronization [req-ddb65915-9cc7-455b-83c7-676fca9dcc27 req-1f6a03a6-8ebe-479b-a62e-4e92275295a0 tempest-ListServersNegativeTestJSON-810802274 tempest-ListServersNegativeTestJSON-810802274-project-member] Enqueued Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 897.321749] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b with Priority: HIGHEST for action security_group_members [ 897.323023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bef7c22-495d-4b65-b8bf-57eb4115026b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.323023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.444387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.444755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.444755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.444835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.444926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.445249] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 897.487032] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.487032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.487032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.487032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.487032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.503111] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 897.515233] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49eab9c1-0cf4-4ab1-83f1-830592c0f740: rpc.has_security_group_logging(os_id): False [ 897.516640] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.537037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.537435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.537543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.537851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.537981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.538320] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.538502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.538561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.538790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.538906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.539476] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.539829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.539975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.540734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.541098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.541323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.541497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.541763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.541937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.542157] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be created. [ 897.611749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.611889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.611961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.612197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.612378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.627895] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 897.665870] env[65511]: INFO networking_nsxv3.common.synchronization [req-1246c4f4-687f-478b-8551-b11fcba6d726 req-9403d222-5b98-4797-a839-b2f28707648f tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 897.665870] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 897.665870] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.666278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.666425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.666731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.667355] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.667355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.667355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.667355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.667656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.667656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.020444] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.171200] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.524353] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.527331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.527331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.527331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.527331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.527331] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 898.562465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.562671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.562671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.564038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.564038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.572505] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 898.673788] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.176803] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.176803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.177013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.177074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.177197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.177299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 899.208616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.208742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.208834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.209223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.209501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.221511] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 899.517262] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 899.517629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.644995] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 899.645241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.394082] env[65511]: INFO networking_nsxv3.common.synchronization [req-e26a5ac5-ed9d-41e9-b276-9a3647e8d9dc req-5ce51efe-0e71-423f-8701-f846e6ab35bf tempest-ServerAddressesTestJSON-877455753 tempest-ServerAddressesTestJSON-877455753-project-member] Enqueued Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 900.394719] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGHEST for action security_group_members [ 900.395124] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.395243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.395353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.395523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.395680] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.396233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.396233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.396233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.396233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.396406] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.585163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 900.585214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.586308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.586308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.586308] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.586308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.586308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.586537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.586727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.586727] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bef7c22-495d-4b65-b8bf-57eb4115026b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.901121] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.901469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.901469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.901583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.901668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.901882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.901977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.902148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.902245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.902352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.902463] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 is going to be updated. [ 900.936597] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.936771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.936910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.937134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.937304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.957479] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: IN_PROGRESS for 2s [ 901.094657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.094657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.094657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.094657] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b is going to be updated. [ 901.136251] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.136251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.136251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.136667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.137020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.152706] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: IN_PROGRESS for 2s [ 901.231715] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 4s [ 902.970953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 in Status: SUCCESS [ 902.971361] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 deletion is rescheduled due to dependency. [ 902.971361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.162076] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b in Status: SUCCESS [ 903.162216] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bef7c22-495d-4b65-b8bf-57eb4115026b deletion is rescheduled due to dependency. [ 903.162353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bef7c22-495d-4b65-b8bf-57eb4115026b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.242211] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 903.242211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.866313] env[65511]: INFO networking_nsxv3.common.synchronization [None req-3c021a1a-2eb5-449c-bd52-0c1125e95292 None None] Enqueued Resource ID: de3b874c-26c3-4935-a216-1b4b4c938985 with Priority: HIGHEST for action port [ 904.867256] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de3b874c-26c3-4935-a216-1b4b4c938985 with Priority: HIGHEST for action port [ 904.867670] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-de3b874c-26c3-4935-a216-1b4b4c938985 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.867817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de3b874c-26c3-4935-a216-1b4b4c938985" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.867853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de3b874c-26c3-4935-a216-1b4b4c938985" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.868421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de3b874c-26c3-4935-a216-1b4b4c938985" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.868421] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de3b874c-26c3-4935-a216-1b4b4c938985',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.370892] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de3b874c-26c3-4935-a216-1b4b4c938985 [ 905.371186] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.371296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.371388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.371581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.371671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.371767] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de3b874c-26c3-4935-a216-1b4b4c938985 already deleted. [ 905.371847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de3b874c-26c3-4935-a216-1b4b4c938985" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.464440] env[65511]: INFO networking_nsxv3.common.synchronization [req-68f565ca-bbab-4a40-8075-8eb91e002419 req-ec486a85-955f-4a3f-9a7f-a3bb6228abea tempest-ServerGroupTestJSON-284154482 tempest-ServerGroupTestJSON-284154482-project-member] Enqueued Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 905.467028] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 905.467028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.467028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.467028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.467028] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.970366] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.970366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.970366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.970366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.970366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.970366] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.971050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.971050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.971050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.971050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.971050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 already deleted. [ 905.971050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.036643] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.036834] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-603" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.037117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-603" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.037336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-603" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.037597] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.037752] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.037863] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.038092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.038227] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.038522] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.038638] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.038743] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.038845] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.038951] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.039548] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.039548] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.061039] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.061518] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.062159] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.062992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-603" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.063358] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-eee26245-cf82-4679-86d4-46a7e064e768 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.063536] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.063653] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.063970] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.064531] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee26245-cf82-4679-86d4-46a7e064e768',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.567924] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.567924] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.567924] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.568247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.568247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.568308] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port eee26245-cf82-4679-86d4-46a7e064e768 not found, creating... [ 906.569268] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.569268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.569268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.569268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.569268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.569599] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.569790] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.569913] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.570250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.570571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.570661] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: eee26245-cf82-4679-86d4-46a7e064e768 is going to be created. [ 906.592328] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.592792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.592792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.592972] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.593131] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.593961] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.977138] env[65511]: INFO networking_nsxv3.common.synchronization [req-dc28a69c-5c5b-42ea-938e-6731e34a1e2c req-2c0c0bb3-8f47-4dfd-adf8-7fcaa3b0f8a3 tempest-ImagesOneServerNegativeTestJSON-1153028932 tempest-ImagesOneServerNegativeTestJSON-1153028932-project-member] Enqueued Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 906.977724] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 with Priority: HIGHEST for action security_group_members [ 906.978041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-49eab9c1-0cf4-4ab1-83f1-830592c0f740 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.978169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.978234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.978435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.978587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.978683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.978745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.979023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.979023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.979123] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49eab9c1-0cf4-4ab1-83f1-830592c0f740',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.290221] env[65511]: INFO networking_nsxv3.common.synchronization [req-68f565ca-bbab-4a40-8075-8eb91e002419 req-03064ea5-0798-472f-8ce5-4bc6a8fbb4fe service nova] Enqueued Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_rules [ 907.290221] env[65511]: INFO networking_nsxv3.common.synchronization [req-68f565ca-bbab-4a40-8075-8eb91e002419 req-03064ea5-0798-472f-8ce5-4bc6a8fbb4fe service nova] Enqueued Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 907.290221] env[65511]: INFO networking_nsxv3.common.synchronization [req-68f565ca-bbab-4a40-8075-8eb91e002419 req-03064ea5-0798-472f-8ce5-4bc6a8fbb4fe service nova] Enqueued Resource ID: eee26245-cf82-4679-86d4-46a7e064e768 with Priority: HIGHEST for action port [ 907.290318] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_rules [ 907.290446] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 907.290538] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eee26245-cf82-4679-86d4-46a7e064e768 with Priority: HIGHEST for action port [ 907.290859] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.290986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.291056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.291568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.291670] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.292551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.292732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.292806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.292972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.293139] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.293242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.293308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.293446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.293544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.293836] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.294628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-eee26245-cf82-4679-86d4-46a7e064e768 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.294628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.294628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.294796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.294841] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eee26245-cf82-4679-86d4-46a7e064e768',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.446058] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f6564e63-7095-4f94-a698-3c6ad6eaf691 None None] Enqueued Resource ID: 77bb0641-5fbf-4963-b228-dbb6374318f6 with Priority: HIGHEST for action port [ 907.447768] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77bb0641-5fbf-4963-b228-dbb6374318f6 with Priority: HIGHEST for action port [ 907.447768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-77bb0641-5fbf-4963-b228-dbb6374318f6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.447768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77bb0641-5fbf-4963-b228-dbb6374318f6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.447768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77bb0641-5fbf-4963-b228-dbb6374318f6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.447938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77bb0641-5fbf-4963-b228-dbb6374318f6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.447938] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77bb0641-5fbf-4963-b228-dbb6374318f6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.482336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.482476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.482521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.482915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.483032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.483238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.483358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.483422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.483578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.483658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.483744] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 is going to be updated. [ 907.519415] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.519636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.519717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.519966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.520231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.530220] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: IN_PROGRESS for 2s [ 907.799954] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.800414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.800472] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.802192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eee26245-cf82-4679-86d4-46a7e064e768 with status ACTIVE [ 907.802192] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.802320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.802320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.802846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.802846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.802929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.802992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.804109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.804346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.809225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.809225] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.809225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.809225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.809225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.809225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.809225] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eee26245-cf82-4679-86d4-46a7e064e768 is going to be updated. [ 907.843283] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.843468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.843555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.843813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.843970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.844150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eee26245-cf82-4679-86d4-46a7e064e768" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.950591] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77bb0641-5fbf-4963-b228-dbb6374318f6 [ 907.950730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.950869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.950963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.951721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.951721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.951721] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77bb0641-5fbf-4963-b228-dbb6374318f6 already deleted. [ 907.951721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77bb0641-5fbf-4963-b228-dbb6374318f6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.308262] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.651653] env[65511]: INFO networking_nsxv3.common.synchronization [None req-bd0880c0-adb1-45e2-a6d6-fca4861c6a27 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 908.652202] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 908.652506] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.653059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.653059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.653059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.653059] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.744021] env[65511]: INFO networking_nsxv3.common.synchronization [None req-17bd781a-f8a3-4eb9-aecb-50f51b223122 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 908.744021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 908.744021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.744021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.815438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.815438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.815438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.815438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.815438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.815438] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 is going to be created. [ 908.839642] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.839642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.839642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.840444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.840646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.854166] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: UNINITIALIZED for 2s [ 909.182093] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.182404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.182527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.182787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.182941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.183063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c already deleted. [ 909.183207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.183374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.183586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.183700] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.542379] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 in Status: SUCCESS [ 909.542379] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49eab9c1-0cf4-4ab1-83f1-830592c0f740 deletion is rescheduled due to dependency. [ 909.542379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49eab9c1-0cf4-4ab1-83f1-830592c0f740" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.706890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.707062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.707107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.707306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.707400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.707497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c already deleted. [ 909.708072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.863795] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: SUCCESS [ 910.864099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.864206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.864413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.864608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.864719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.864782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.864933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.865019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.865102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.865195] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.238828] env[65511]: INFO networking_nsxv3.common.synchronization [req-5d209a6f-da09-4228-9115-ec59f8710ea9 req-8c5900e9-e86b-47cb-967e-f24670dd251f tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 911.239825] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 911.239825] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.239825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.240034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.240167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.240343] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.240445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.240506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.240667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.240749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.240840] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.348965] env[65511]: INFO networking_nsxv3.common.synchronization [req-1bb1b120-c9bb-43b4-a31a-e0ef2db2c2f3 req-0f5f81f1-659f-4ccd-91ee-66fea96fd4c8 tempest-TenantUsagesTestJSON-1098038221 tempest-TenantUsagesTestJSON-1098038221-project-member] Enqueued Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 911.349512] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 911.350099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.350099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.350255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.350995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.350995] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.350995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.350995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.352099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.352494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.352494] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.367768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.368148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.368148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.368258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.368384] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.368488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.368538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.368687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.368766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.368849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.368986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.369084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.369140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.369810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.369810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.370117] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.702300] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.702493] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.702606] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.702868] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.703134] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.703319] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.703462] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.703710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.703851] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.704072] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.704498] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.704623] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.704732] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.704843] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.704948] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.705092] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.724516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.724626] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.724764] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.724936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.725270] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-8bbc6f0f-7392-4270-bbfd-08c43739e99b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.725438] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.725552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.725870] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.726013] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bbc6f0f-7392-4270-bbfd-08c43739e99b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.742412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.742569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.742640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.742847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.742934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.743137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.743236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.743297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.743443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.743520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.743610] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 911.773511] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.773924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.773924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.774058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.774229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.786548] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 911.857034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.857034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.857034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 already deleted. [ 911.857034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.871950] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ce43c3-59e1-4b66-8efa-669b47d29012: rpc.has_security_group_logging(os_id): False [ 911.891920] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.891920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.891920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.891920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.891920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.892220] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.892992] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.893294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.893294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.893294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.893392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.893440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.893605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.893676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.893764] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 is going to be created. [ 911.955110] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.955266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.955327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.955542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.955721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.966437] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: IN_PROGRESS for 2s [ 912.228553] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.228724] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.228837] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.229170] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.229286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.229953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 8bbc6f0f-7392-4270-bbfd-08c43739e99b not found, creating... [ 912.229953] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.229953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.229953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.230155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.230292] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.230571] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.230832] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.230892] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.231070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.231864] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.231864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 8bbc6f0f-7392-4270-bbfd-08c43739e99b is going to be created. [ 912.255096] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.255096] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.255334] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.255445] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.255693] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.256017] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.009635] env[65511]: INFO networking_nsxv3.common.synchronization [req-1bb1b120-c9bb-43b4-a31a-e0ef2db2c2f3 req-fdf24f06-5b0a-49ff-95e5-a12b3fdaad54 service nova] Enqueued Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_rules [ 913.009878] env[65511]: INFO networking_nsxv3.common.synchronization [req-1bb1b120-c9bb-43b4-a31a-e0ef2db2c2f3 req-fdf24f06-5b0a-49ff-95e5-a12b3fdaad54 service nova] Enqueued Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 913.009972] env[65511]: INFO networking_nsxv3.common.synchronization [req-1bb1b120-c9bb-43b4-a31a-e0ef2db2c2f3 req-fdf24f06-5b0a-49ff-95e5-a12b3fdaad54 service nova] Enqueued Resource ID: 8bbc6f0f-7392-4270-bbfd-08c43739e99b with Priority: HIGHEST for action port [ 913.010467] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_rules [ 913.010604] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 913.010795] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbc6f0f-7392-4270-bbfd-08c43739e99b with Priority: HIGHEST for action port [ 913.011127] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.011248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.011314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.011734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.011855] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.013178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.013308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.014029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.014029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.014029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.014179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.014210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.014361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.014516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.014791] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.015736] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bbc6f0f-7392-4270-bbfd-08c43739e99b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.015839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.016461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.016636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.016733] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bbc6f0f-7392-4270-bbfd-08c43739e99b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.513692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.513692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.518764] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.519068] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bbc6f0f-7392-4270-bbfd-08c43739e99b with status ACTIVE [ 913.519429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.519570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.519638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.519841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.519928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.520125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.520222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.520283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.520530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.520621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.520802] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.520894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.520956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.521121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.521197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.521307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bbc6f0f-7392-4270-bbfd-08c43739e99b is going to be updated. [ 913.544674] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.544833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.544958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.545166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.545326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.545495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bbc6f0f-7392-4270-bbfd-08c43739e99b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.797269] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 913.797505] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 913.797661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.979054] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: SUCCESS [ 913.979054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.023703] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.526852] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.527557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.527557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.527557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.527557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.527557] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 is going to be created. [ 914.532817] env[65511]: INFO networking_nsxv3.common.synchronization [req-5f430371-2a2f-4b4e-b659-c5bbabcdb6ed req-9eb1620f-d7d4-4acb-93c0-ac2189141d59 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 914.533385] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 914.533705] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.533823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.533889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.534163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.534263] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.534362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.534422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.534578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.534661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.534760] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.562699] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.562699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.562699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.562699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.562699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.570947] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: UNINITIALIZED for 2s [ 914.932356] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.932600] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.932728] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.933051] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.933432] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.933620] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.933800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.934125] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.934339] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.934658] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.934834] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.934990] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.935171] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.935379] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.935508] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.935644] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.957555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.957755] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.957912] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.958165] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.958510] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.958696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.958838] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.959293] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.959434] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1871cf2b-ae0c-4524-8e09-c8a2698f8dd6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.037161] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.037501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.037554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.037775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.072280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.072280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.072280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.072280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.072548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.072548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.072620] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 915.108031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.108233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.108233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.108547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.108827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.119522] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 915.461519] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.461743] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.461871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.462201] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.462369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.462501] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 not found, creating... [ 915.462751] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.462900] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.463096] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.463316] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.463449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.463732] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.463903] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.464038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.464316] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.464396] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.464532] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 is going to be created. [ 915.485698] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.485901] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.486028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.486378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.486605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.486822] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.218940] env[65511]: INFO networking_nsxv3.common.synchronization [req-5f430371-2a2f-4b4e-b659-c5bbabcdb6ed req-26547f5a-feb1-48e1-8417-53ae9e59b908 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 916.218940] env[65511]: INFO networking_nsxv3.common.synchronization [req-5f430371-2a2f-4b4e-b659-c5bbabcdb6ed req-26547f5a-feb1-48e1-8417-53ae9e59b908 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 916.218940] env[65511]: INFO networking_nsxv3.common.synchronization [req-5f430371-2a2f-4b4e-b659-c5bbabcdb6ed req-26547f5a-feb1-48e1-8417-53ae9e59b908 service nova] Enqueued Resource ID: 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 with Priority: HIGHEST for action port [ 916.219456] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 916.219456] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 916.219456] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 with Priority: HIGHEST for action port [ 916.219603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.219713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.219786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.219972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.220072] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.221059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.221159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.221443] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.221795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.221795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.221895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.221895] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1871cf2b-ae0c-4524-8e09-c8a2698f8dd6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.580210] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: SUCCESS [ 916.580448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.580612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.580824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.581030] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.581145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.581209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.581362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.581439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.581522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.581609] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.723777] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.723935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.726513] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 with status ACTIVE [ 916.726613] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.726763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.726857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.727099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.727202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.727499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.727659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.727760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.728012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.728138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.728403] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.728551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.728640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.728866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.728978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.729121] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1871cf2b-ae0c-4524-8e09-c8a2698f8dd6 is going to be updated. [ 916.754365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.754499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.754573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.754809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.754966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.755195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1871cf2b-ae0c-4524-8e09-c8a2698f8dd6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.084356] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.084512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.084609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.084805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.084973] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.085088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.085207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.085302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.085388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.085502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.085661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.085756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.085812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.086564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.086564] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.086564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.086912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.086988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.087098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.087189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.087289] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.132054] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 917.132054] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 deletion is rescheduled due to dependency. [ 917.132054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.132054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.132054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.132435] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.132435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.132435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.132610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.132733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.132841] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.590822] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64ff0f9f-a392-4fb0-b465-f891d95ca0f1: rpc.has_security_group_logging(os_id): False [ 917.614569] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.614905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.614905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.615015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.615809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.615809] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.615809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.615809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.615809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.615809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.616062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.616062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.616062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.616285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.616285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.616449] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.617142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.617142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.617142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.617142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.617142] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 is going to be created. [ 917.636629] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.697766] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.697766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.698017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.698075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.698290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.710482] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: IN_PROGRESS for 2s [ 918.138847] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.641709] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.642148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.642148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.642381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.642495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.642634] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 918.672375] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.672743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.672743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.672847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.673031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.683129] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 919.724199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: SUCCESS [ 919.724480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.444725] env[65511]: INFO networking_nsxv3.common.synchronization [req-4d3ff53e-b3bc-4d24-bcd9-62ff497d35b9 req-24deea7c-e778-4877-9c59-62956bf0cc03 tempest-ServerGroupTestJSON-284154482 tempest-ServerGroupTestJSON-284154482-project-member] Enqueued Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 920.445296] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 with Priority: HIGHEST for action security_group_members [ 920.445612] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ce43c3-59e1-4b66-8efa-669b47d29012 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.445734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.445799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.445994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.446334] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.446441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.446505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.446675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.446761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.446854] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ce43c3-59e1-4b66-8efa-669b47d29012',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.694849] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 920.694849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.694849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.694849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.694849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.695171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.695171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.695339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.695430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.695538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.695643] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.951926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.951926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.951926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.952404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.952597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.952832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.952942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.953013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.953190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.953272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.953360] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 is going to be updated. [ 920.989562] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.989562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.989562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.989870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.990094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.005823] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: IN_PROGRESS for 2s [ 921.198714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.198862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.198941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.199305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.199382] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.199453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.199518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.199669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.199757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.199842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.199989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.200096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.200159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.200300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.200450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.200559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.200657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.200813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.200890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.200970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.201073] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.263958] env[65511]: INFO networking_nsxv3.common.synchronization [req-298fdb88-d695-4080-a538-57b7749736c9 req-c9aec7d7-be1d-4bbe-ac50-8f40a1ecb00f tempest-ServersTestJSON-2089008876 tempest-ServersTestJSON-2089008876-project-member] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 921.264542] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 921.264853] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.265159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.265222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.265495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.265658] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.266069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.266069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.266069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.266069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.266266] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.428065] env[65511]: INFO networking_nsxv3.common.synchronization [req-47c7f760-a4c5-4a1a-bcf4-671161211f3c req-31b9d1fb-7822-4a36-8bc3-1af0c32fbdf8 tempest-ServersTestBootFromVolume-1594891053 tempest-ServersTestBootFromVolume-1594891053-project-member] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 921.428741] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGHEST for action security_group_members [ 921.429071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.429188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.429256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.429447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.429603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.429699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.429760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.429906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.429989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.430096] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.703711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7e334b-4f27-4441-85ca-d5b22f8c8f07: rpc.has_security_group_logging(os_id): False [ 921.725240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.725240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.725240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.725240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.725485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.725533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.725626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.725682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.725951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.725951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.726200] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.726292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.726327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.726453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.726526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.726724] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.726819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.726880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.728290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.728847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.728847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 921.768543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.768697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.768697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.768949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.769017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.769238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.769342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.769407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.769573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.769645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.769733] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 already deleted. [ 921.769840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.812040] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.812040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.812040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.812040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.812040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.829498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 921.935321] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.935321] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.935321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.935321] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d is going to be updated. [ 921.979590] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.979590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.979590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.980135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.980135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.992894] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: IN_PROGRESS for 2s [ 922.069289] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.069617] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-180" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.069694] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-180" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.070093] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-180" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.070366] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.070569] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.070762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.071076] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.071235] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.071499] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.071613] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.071756] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.071905] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.072075] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.072234] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.072436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.096457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.096637] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.096800] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.097073] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-180" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.097421] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-35779495-7036-4bb8-abb2-b6bd5b4acdc1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.097634] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.097746] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.098295] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.098295] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35779495-7036-4bb8-abb2-b6bd5b4acdc1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.600858] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.601100] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.601225] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.601519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.601663] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.601824] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 35779495-7036-4bb8-abb2-b6bd5b4acdc1 not found, creating... [ 922.602091] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.602245] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.602425] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.602646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.603505] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.603836] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.603997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.604487] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.604721] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.604847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.604984] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 35779495-7036-4bb8-abb2-b6bd5b4acdc1 is going to be created. [ 922.630369] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.630582] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.630692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.630969] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.631209] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.631437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.740362] env[65511]: INFO networking_nsxv3.common.synchronization [None req-b40d0b67-af8b-4999-b5ac-6fca6f47a94d None None] Enqueued Resource ID: 352bc3fc-737d-466b-8d16-2e8aaa67be29 with Priority: HIGHEST for action port [ 922.740994] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 352bc3fc-737d-466b-8d16-2e8aaa67be29 with Priority: HIGHEST for action port [ 922.745234] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-352bc3fc-737d-466b-8d16-2e8aaa67be29 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.745383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-352bc3fc-737d-466b-8d16-2e8aaa67be29" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.745466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-352bc3fc-737d-466b-8d16-2e8aaa67be29" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.745717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-352bc3fc-737d-466b-8d16-2e8aaa67be29" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.745807] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('352bc3fc-737d-466b-8d16-2e8aaa67be29',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.017442] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 in Status: SUCCESS [ 923.017826] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ce43c3-59e1-4b66-8efa-669b47d29012 deletion is rescheduled due to dependency. [ 923.017826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ce43c3-59e1-4b66-8efa-669b47d29012" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.248956] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 352bc3fc-737d-466b-8d16-2e8aaa67be29 [ 923.248956] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.248956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.248956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.248956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.248956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.249834] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:352bc3fc-737d-466b-8d16-2e8aaa67be29 already deleted. [ 923.250782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-352bc3fc-737d-466b-8d16-2e8aaa67be29" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.381201] env[65511]: INFO networking_nsxv3.common.synchronization [req-298fdb88-d695-4080-a538-57b7749736c9 req-14cb805a-979c-4c3e-8088-305d226354c4 service nova] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 923.381369] env[65511]: INFO networking_nsxv3.common.synchronization [req-298fdb88-d695-4080-a538-57b7749736c9 req-14cb805a-979c-4c3e-8088-305d226354c4 service nova] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 923.381509] env[65511]: INFO networking_nsxv3.common.synchronization [req-298fdb88-d695-4080-a538-57b7749736c9 req-14cb805a-979c-4c3e-8088-305d226354c4 service nova] Enqueued Resource ID: 35779495-7036-4bb8-abb2-b6bd5b4acdc1 with Priority: HIGHEST for action port [ 923.382108] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_rules [ 923.382255] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 923.382357] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35779495-7036-4bb8-abb2-b6bd5b4acdc1 with Priority: HIGHEST for action port [ 923.382628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.382789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.382846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.383053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.383135] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.384479] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.384610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.384676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.384880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.385066] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.385166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.385231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.385414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.385506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.385599] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.388503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-35779495-7036-4bb8-abb2-b6bd5b4acdc1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.388624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.388673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.389565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.389565] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35779495-7036-4bb8-abb2-b6bd5b4acdc1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.416625] env[65511]: INFO networking_nsxv3.common.synchronization [req-b9aa43cc-ca16-44a7-aa70-d9cd35e33f10 req-155e9a53-ec46-489c-9911-04b6c612c5e5 tempest-MigrationsAdminTest-1067937847 tempest-MigrationsAdminTest-1067937847-project-member] Enqueued Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 923.418374] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 with Priority: HIGHEST for action security_group_members [ 923.419129] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-232b7b09-b30d-4f2e-95a8-0315ce8667b1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.419256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.419256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.420824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.420824] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.420824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.420824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.421917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.422093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.422291] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('232b7b09-b30d-4f2e-95a8-0315ce8667b1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.832831] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6e6edbfb-505d-48c2-b0a4-b919bf5930e4 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 923.834702] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 923.838023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.838023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.838023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.838023] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.850711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 923.850711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.891113] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.892877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.892877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.892877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35779495-7036-4bb8-abb2-b6bd5b4acdc1 with status ACTIVE [ 923.892877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.892877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.893263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.893263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.893263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.893387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.893486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.893536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.893697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.893766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.893942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.895162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.895162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.895162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.895162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.895162] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35779495-7036-4bb8-abb2-b6bd5b4acdc1 is going to be updated. [ 923.904088] env[65511]: INFO networking_nsxv3.common.synchronization [req-c72cc345-e78c-4dbd-aa18-e87ce70626bd req-aaf4cabf-540e-490c-b75d-21717a78b4eb tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 923.905293] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 923.905912] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.906459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.906538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.906853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.907723] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.907723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.907723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.907723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.907925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.907925] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.922497] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.922728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.922796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.922998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.923154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.923322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35779495-7036-4bb8-abb2-b6bd5b4acdc1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.926806] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.926806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.926806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.926964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.957587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.957701] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.957781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.957821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.958066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.958130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.958205] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 is going to be updated. [ 923.991905] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.992134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.992234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.992495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.992679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.018887] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: IN_PROGRESS for 2s [ 924.019982] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d in Status: SUCCESS [ 924.020263] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d deletion is rescheduled due to dependency. [ 924.020447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.299660] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.299864] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.299984] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.300254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.300608] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.300786] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.300917] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.301362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.301514] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.301724] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.301830] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.301934] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.302049] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.302158] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.302264] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.302392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.324761] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.324923] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.325057] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.325240] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.325551] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-e73c4500-9f09-4bc5-8a49-7d86859325a1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.325715] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.325825] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.326229] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.326384] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e73c4500-9f09-4bc5-8a49-7d86859325a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.342102] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.393799] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.410635] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.410852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.410852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.411086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.411249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.411375] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.411470] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.411529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.411678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.411765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.411847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 already deleted. [ 924.411926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.830800] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.831034] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.831164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.831454] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.831599] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.831748] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port e73c4500-9f09-4bc5-8a49-7d86859325a1 not found, creating... [ 924.832054] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.832192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.832305] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.832517] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.832650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.832932] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.833103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.833224] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.833450] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.833588] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.833727] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: e73c4500-9f09-4bc5-8a49-7d86859325a1 is going to be created. [ 924.845264] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.858034] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.858034] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.858273] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.858526] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.858823] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.859201] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.897480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.897635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.897704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.897918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.898019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.898128] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 is going to be created. [ 924.933422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.933422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.933568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.933764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.933926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.945918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: UNINITIALIZED for 2s [ 924.986157] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e6774402-c7e3-4117-9dee-18a65e1893f3 tempest-ServersTestManualDisk-1702256595 tempest-ServersTestManualDisk-1702256595-project-member] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 924.988042] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 924.988042] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.988042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.988042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.988042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.988042] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.099797] env[65511]: INFO networking_nsxv3.common.synchronization [None req-96075cf6-8c0d-4809-9fe6-23fd6a747303 tempest-ServersTestManualDisk-1702256595 tempest-ServersTestManualDisk-1702256595-project-member] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 925.100631] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 925.101026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.101026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.242626] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6a275c98-b825-46c7-b9b9-566cbe769260 None None] Enqueued Resource ID: 67fe555c-deff-48e7-b2f4-8f26656b1ca4 with Priority: HIGHEST for action port [ 925.244659] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fe555c-deff-48e7-b2f4-8f26656b1ca4 with Priority: HIGHEST for action port [ 925.244659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-67fe555c-deff-48e7-b2f4-8f26656b1ca4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.245474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67fe555c-deff-48e7-b2f4-8f26656b1ca4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.245832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67fe555c-deff-48e7-b2f4-8f26656b1ca4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.246243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67fe555c-deff-48e7-b2f4-8f26656b1ca4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.246444] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67fe555c-deff-48e7-b2f4-8f26656b1ca4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.349551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.349551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.349551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.349690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.349690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.349807] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 925.380377] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.380377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.380377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.381293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.381293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.391033] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 925.510579] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.510579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.510579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.510781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.510871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.510966] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee already deleted. [ 925.511061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.511219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.511388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.511463] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.585443] env[65511]: INFO networking_nsxv3.common.synchronization [req-c72cc345-e78c-4dbd-aa18-e87ce70626bd req-405319c6-a71b-40e1-b1b8-ca7c370ca72a service nova] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 925.585821] env[65511]: INFO networking_nsxv3.common.synchronization [req-c72cc345-e78c-4dbd-aa18-e87ce70626bd req-405319c6-a71b-40e1-b1b8-ca7c370ca72a service nova] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 925.585821] env[65511]: INFO networking_nsxv3.common.synchronization [req-c72cc345-e78c-4dbd-aa18-e87ce70626bd req-405319c6-a71b-40e1-b1b8-ca7c370ca72a service nova] Enqueued Resource ID: e73c4500-9f09-4bc5-8a49-7d86859325a1 with Priority: HIGHEST for action port [ 925.586845] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_rules [ 925.587062] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 925.587441] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73c4500-9f09-4bc5-8a49-7d86859325a1 with Priority: HIGHEST for action port [ 925.588052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.588309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.588441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.588768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.588905] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.589925] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.590139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.590234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.590505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.590779] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.590948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.591395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.591395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.591395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.591592] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.592552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e73c4500-9f09-4bc5-8a49-7d86859325a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.592769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.593031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.593274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.593441] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e73c4500-9f09-4bc5-8a49-7d86859325a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.749602] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67fe555c-deff-48e7-b2f4-8f26656b1ca4 [ 925.749602] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.749797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.749797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.750024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.750116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.750214] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67fe555c-deff-48e7-b2f4-8f26656b1ca4 already deleted. [ 925.750314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67fe555c-deff-48e7-b2f4-8f26656b1ca4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.031320] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 in Status: SUCCESS [ 926.031479] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 232b7b09-b30d-4f2e-95a8-0315ce8667b1 deletion is rescheduled due to dependency. [ 926.031516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-232b7b09-b30d-4f2e-95a8-0315ce8667b1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.037542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.038135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.038135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.038915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.038915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.038915] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee already deleted. [ 926.038915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.095623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.095701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.095885] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.098632] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e73c4500-9f09-4bc5-8a49-7d86859325a1 with status ACTIVE [ 926.098632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.098632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.098632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.099019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.099019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.099019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.099121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.099538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.099538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.099538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.099538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e73c4500-9f09-4bc5-8a49-7d86859325a1 is going to be updated. [ 926.129350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.129350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.129350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.129350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.129350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.129350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e73c4500-9f09-4bc5-8a49-7d86859325a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.603910] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.961652] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: SUCCESS [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.961652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.961652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.961652] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.088229] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.088549] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.088704] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.089152] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.089489] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.089677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.089806] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.090100] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.090276] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.090520] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.090680] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.090836] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.090970] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.091128] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.091290] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.091447] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.106310] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.106483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.106544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.106815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.106911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.107015] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 is going to be created. [ 927.110879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.111053] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.111191] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.111353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.111707] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-afd09d10-8a41-4a4d-a9e5-7430d88382c5 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.111888] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.112029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.112355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.112498] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd09d10-8a41-4a4d-a9e5-7430d88382c5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.131750] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.132162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.132162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.132234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.132390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.142780] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: UNINITIALIZED for 2s [ 927.401642] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 927.401866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.464456] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.616038] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.616038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.616038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.616038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.616038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.616410] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port afd09d10-8a41-4a4d-a9e5-7430d88382c5 not found, creating... [ 927.616867] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.617047] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.617168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.617455] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.617578] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.617870] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.618090] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.618224] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.618435] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.618583] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.618729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: afd09d10-8a41-4a4d-a9e5-7430d88382c5 is going to be created. [ 927.638153] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.638153] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.638153] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.638418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.638532] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.638747] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.967692] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e9f87-12dd-4e82-864b-ae5b61fc4413: rpc.has_security_group_logging(os_id): False [ 927.991763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.991964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.992021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.992221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.992317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.992553] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.992650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.992713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.992861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.992938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.993036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 is going to be created. [ 928.066718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.066718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.066954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.066954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.067543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.079035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: IN_PROGRESS for 2s [ 928.354578] env[65511]: INFO networking_nsxv3.common.synchronization [req-1b579c7a-68b1-47be-b8d6-8e58b83613a2 req-3b7f6fe2-8f7b-4a3f-a2dc-1ef8a303e484 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 928.354856] env[65511]: INFO networking_nsxv3.common.synchronization [req-1b579c7a-68b1-47be-b8d6-8e58b83613a2 req-3b7f6fe2-8f7b-4a3f-a2dc-1ef8a303e484 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 928.354889] env[65511]: INFO networking_nsxv3.common.synchronization [req-1b579c7a-68b1-47be-b8d6-8e58b83613a2 req-3b7f6fe2-8f7b-4a3f-a2dc-1ef8a303e484 service nova] Enqueued Resource ID: afd09d10-8a41-4a4d-a9e5-7430d88382c5 with Priority: HIGHEST for action port [ 928.355450] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 928.355583] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 928.355684] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd09d10-8a41-4a4d-a9e5-7430d88382c5 with Priority: HIGHEST for action port [ 928.355968] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.356491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.356528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.356718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.356805] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.358560] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.358560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.358560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.358758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.359029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.359371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.359444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.359604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.359691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.359789] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.360628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-afd09d10-8a41-4a4d-a9e5-7430d88382c5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.361370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.361462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.361695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.361871] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd09d10-8a41-4a4d-a9e5-7430d88382c5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.859137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.859956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.864785] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.866032] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afd09d10-8a41-4a4d-a9e5-7430d88382c5 with status ACTIVE [ 928.866032] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.866156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.866269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.866564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.866675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.866873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.866974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.867050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.867389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.867486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.867654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.867748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.867807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.867950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.868047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.868137] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afd09d10-8a41-4a4d-a9e5-7430d88382c5 is going to be updated. [ 928.892345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.892519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.892519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.893105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.893105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.893105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afd09d10-8a41-4a4d-a9e5-7430d88382c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.153637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: SUCCESS [ 929.153859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.154028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.154275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.154473] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.154584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.154649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.154803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.154886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.154969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.155079] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.370794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.657668] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.873047] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.873239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.873348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.873674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.873838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.873904] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 929.913530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.913530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.913530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.913809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.913809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.926216] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 930.097355] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: SUCCESS [ 930.098107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.160883] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8: rpc.has_security_group_logging(os_id): False [ 930.181017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.181242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.181301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.181540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.181672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.181959] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.182109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.182410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.182716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.182915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.183074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 is going to be created. [ 930.254720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.254871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.254980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.255164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.255351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.266265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: IN_PROGRESS for 2s [ 931.261916] env[65511]: INFO networking_nsxv3.common.synchronization [req-732a69ef-b829-4485-b348-e57a42309e40 req-4dee1a32-ab5a-4024-b906-eb722a2d19ca tempest-TenantUsagesTestJSON-1098038221 tempest-TenantUsagesTestJSON-1098038221-project-member] Enqueued Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 931.262311] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGHEST for action security_group_members [ 931.262365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.262493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.262552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.262756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.262913] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.263047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.263111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.263268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.263357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.263447] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.523614] env[65511]: INFO networking_nsxv3.common.synchronization [req-019867a0-b735-4adb-a86d-8d6f55c86821 req-fa9abedb-a1fa-4af6-80af-c013dce1c93f tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 931.524204] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 931.524559] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.524678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.524776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.525079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.525272] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.525399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.525468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.525648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.525788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.525843] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.766023] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.766574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.766574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.766574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.766805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.766854] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.766945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.767016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.767187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.767362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.767362] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 is going to be updated. [ 931.800289] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.800513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.800513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.800853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.801095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.812350] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: IN_PROGRESS for 2s [ 931.937387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 931.937623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.937800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.938078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.938226] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.938394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.938474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.939734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.939734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.939734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.939734] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.947594] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.947840] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.947925] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.948245] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.948497] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.948642] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.948744] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.948952] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.949572] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.949572] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.949572] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.949572] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.949829] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.949829] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.949904] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.949964] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.973204] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.973367] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.973510] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.973689] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.973996] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-140f404c-84ab-4b3f-97a1-f49ce8598434 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.974181] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.974299] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.974619] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.974826] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140f404c-84ab-4b3f-97a1-f49ce8598434',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.028857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.029605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.029605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.029605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.029793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.029965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.030058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.030058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.030212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.030286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.030375] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c already deleted. [ 932.030451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.296955] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: SUCCESS [ 932.297361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.440929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.441159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.441219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.441420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.441572] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.441698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.441807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.442062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.442163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.442255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.442407] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.442501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.442562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.442708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.442846] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.442937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.442996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.443150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.443227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.443338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.443526] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.477062] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.477403] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.477589] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.478193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.478193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.478388] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 140f404c-84ab-4b3f-97a1-f49ce8598434 not found, creating... [ 932.478689] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.478860] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.478975] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.479237] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.479384] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.479734] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.479856] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.479958] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.480143] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.480273] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.480409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 140f404c-84ab-4b3f-97a1-f49ce8598434 is going to be created. [ 932.506682] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.507038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.507038] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.507324] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.507607] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.507784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.946116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7e334b-4f27-4441-85ca-d5b22f8c8f07: rpc.has_security_group_logging(os_id): False [ 932.965280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.965475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.965513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.965719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.965809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.966017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.966146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.966199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.966385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.966466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.966699] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.966802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.966860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.967129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.967129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.967261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.967375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.967465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.967614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.967687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.967772] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 933.029881] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.029881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.029881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.029881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.029881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.047637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 933.244739] env[65511]: INFO networking_nsxv3.common.synchronization [req-019867a0-b735-4adb-a86d-8d6f55c86821 req-675018f2-c4df-4b81-a991-4a5edbbd37fc service nova] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_rules [ 933.245594] env[65511]: INFO networking_nsxv3.common.synchronization [req-019867a0-b735-4adb-a86d-8d6f55c86821 req-675018f2-c4df-4b81-a991-4a5edbbd37fc service nova] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 933.245594] env[65511]: INFO networking_nsxv3.common.synchronization [req-019867a0-b735-4adb-a86d-8d6f55c86821 req-675018f2-c4df-4b81-a991-4a5edbbd37fc service nova] Enqueued Resource ID: 140f404c-84ab-4b3f-97a1-f49ce8598434 with Priority: HIGHEST for action port [ 933.246625] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_rules [ 933.246625] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 933.246625] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140f404c-84ab-4b3f-97a1-f49ce8598434 with Priority: HIGHEST for action port [ 933.246625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.246625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.246625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.247087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.247087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.248143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.248143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.248143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.248334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.248439] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.248490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.248525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.248688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.248772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.248857] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.250031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-140f404c-84ab-4b3f-97a1-f49ce8598434 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.250214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.250214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.250373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.250447] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140f404c-84ab-4b3f-97a1-f49ce8598434',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.752335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.752335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.752624] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.753383] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 140f404c-84ab-4b3f-97a1-f49ce8598434 with status ACTIVE [ 933.754117] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.754259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.754350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.754557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.754647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.754822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.754932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.754978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.755134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.755210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.755390] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.755500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.755602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.755759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.755834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.755964] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 140f404c-84ab-4b3f-97a1-f49ce8598434 is going to be updated. [ 933.882606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.882813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.882813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.883062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.884832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.884832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-140f404c-84ab-4b3f-97a1-f49ce8598434" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.884832] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 in Status: SUCCESS [ 933.884832] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 deletion is rescheduled due to dependency. [ 933.884832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.121572] env[65511]: INFO networking_nsxv3.common.synchronization [req-2c36bd9f-01fe-4c37-978e-48f1caef22fd req-7b1fc155-4fb5-4025-ab55-e956258af90d tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 934.122142] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 934.122454] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.122551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.258097] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.760720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.761023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.761023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.761171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.761350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.761447] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be created. [ 934.785964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.786137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.786205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.786632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.786733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.798303] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: UNINITIALIZED for 2s [ 934.947933] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.948157] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.948262] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.948571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.948888] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.949081] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.949187] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.949394] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.949531] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.949739] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.949862] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.949969] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.950090] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.950232] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.950344] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.950475] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.972215] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.972407] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.972529] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.972714] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.973097] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-ec015a89-e93f-481b-b630-7f06ca85a78a taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.973289] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.973360] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.973681] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.973824] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec015a89-e93f-481b-b630-7f06ca85a78a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.062022] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 935.062269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.476939] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.477382] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.477585] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.478059] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.478208] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.478529] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port ec015a89-e93f-481b-b630-7f06ca85a78a not found, creating... [ 935.478872] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.479132] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.479208] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.480052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.480253] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.480670] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.480959] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.481264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.481495] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.481657] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.481831] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: ec015a89-e93f-481b-b630-7f06ca85a78a is going to be created. [ 935.507458] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.507701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.507887] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.508193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.508450] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.508761] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.893888] env[65511]: INFO networking_nsxv3.common.synchronization [req-eb7938d4-3087-4c8b-8d58-46f20fc1af0f req-f084a171-3266-4824-b25e-8b2d75b9a3b3 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 935.894581] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 935.894970] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.895046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.895112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.895288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.895492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.895667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.895758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.895939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.896096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.896212] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.213208] env[65511]: INFO networking_nsxv3.common.synchronization [req-2c36bd9f-01fe-4c37-978e-48f1caef22fd req-27644408-4e0e-4cfd-8ac5-dbab570f5448 service nova] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_rules [ 936.213208] env[65511]: INFO networking_nsxv3.common.synchronization [req-2c36bd9f-01fe-4c37-978e-48f1caef22fd req-27644408-4e0e-4cfd-8ac5-dbab570f5448 service nova] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 936.213208] env[65511]: INFO networking_nsxv3.common.synchronization [req-2c36bd9f-01fe-4c37-978e-48f1caef22fd req-27644408-4e0e-4cfd-8ac5-dbab570f5448 service nova] Enqueued Resource ID: ec015a89-e93f-481b-b630-7f06ca85a78a with Priority: HIGHEST for action port [ 936.213208] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_rules [ 936.214614] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 936.214870] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec015a89-e93f-481b-b630-7f06ca85a78a with Priority: HIGHEST for action port [ 936.215307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.215542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.219026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.219026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.219026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec015a89-e93f-481b-b630-7f06ca85a78a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.219026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.219026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.219026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.219026] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec015a89-e93f-481b-b630-7f06ca85a78a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.398807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.399161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.399161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.399276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.399368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.399705] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.399705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.399705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.399863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.399945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.400049] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 936.430586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.430763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.430807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.430999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.431196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.439720] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 936.731021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec015a89-e93f-481b-b630-7f06ca85a78a with status ACTIVE [ 936.731021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.731021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.731021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.731021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.731021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec015a89-e93f-481b-b630-7f06ca85a78a is going to be updated. [ 936.760057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.760057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.760057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.760057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.760057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.760287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec015a89-e93f-481b-b630-7f06ca85a78a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.809881] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 936.810108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.810281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.810510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.810746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.810868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.810934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.811108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.811184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.811283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.811404] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.812637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.812819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.812998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.813145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.813207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.813381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.813474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.814532] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.957464] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-e0a26b9f-6442-4ae4-8c78-6fffa95d8f13 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 936.957995] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 936.958671] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.958808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.958875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.960048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.960547] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.960688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.960777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.961026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.961139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.961245] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.315526] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.315708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.315825] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.431901] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-b61b044d-58e6-4bd0-b6bd-9346079bf625 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 937.432558] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 937.432965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.433060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.465340] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.465639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.468550] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.468550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 already deleted. [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468550] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.468550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.469167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.818772] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.918300] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-b7d4152e-a4d4-42c7-8896-e6e2f6656414 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 937.918822] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 937.919160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.919260] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.975696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.975696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.975696] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 already deleted. [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.975696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.975696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.976781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.976781] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.323858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.323858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.323858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.323858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.323858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.323858] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be updated. [ 938.359997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.359997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.359997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.359997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.359997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.371254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 938.450316] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 938.450473] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 938.451114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.463473] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.463655] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.463771] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.464114] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.464380] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.464528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.464635] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.464995] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.466049] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.466049] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.466049] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.466049] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.466049] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.466403] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.466573] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.466749] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.478331] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.478508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.478546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.478796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.478886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.479086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.479184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.479541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.479541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.479541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.479662] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 already deleted. [ 938.479732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.486662] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.486850] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.487070] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.487435] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.487779] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-979a7512-64d1-4b99-bcfc-1f901b469c09 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.488252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.488252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.488389] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.488790] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979a7512-64d1-4b99-bcfc-1f901b469c09',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.991540] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.991540] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.992044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.992044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.992195] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.992380] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 979a7512-64d1-4b99-bcfc-1f901b469c09 not found, creating... [ 938.992668] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.992810] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.992924] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.993215] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.993428] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.993710] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.993873] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.994304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.994584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.994804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.995168] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 979a7512-64d1-4b99-bcfc-1f901b469c09 is going to be created. [ 939.018814] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.019033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.019150] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.020431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.020431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.020431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.773205] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-4509b538-875e-4d20-a299-a5bcc0a7c1c7 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 939.773939] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-4509b538-875e-4d20-a299-a5bcc0a7c1c7 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 939.773939] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-4509b538-875e-4d20-a299-a5bcc0a7c1c7 service nova] Enqueued Resource ID: 979a7512-64d1-4b99-bcfc-1f901b469c09 with Priority: HIGHEST for action port [ 939.774394] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 939.774531] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 939.774651] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 979a7512-64d1-4b99-bcfc-1f901b469c09 with Priority: HIGHEST for action port [ 939.777218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.777218] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.777218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.777218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.777218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.777818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.777818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.777818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.777818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.777818] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.784305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-979a7512-64d1-4b99-bcfc-1f901b469c09 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.784526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.784579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.784977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.785055] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('979a7512-64d1-4b99-bcfc-1f901b469c09',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.290916] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.290916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.290916] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.290916] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 979a7512-64d1-4b99-bcfc-1f901b469c09 with status ACTIVE [ 940.291876] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.292195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.292361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.292805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293331] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.293562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.293711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.296050] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.296050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.296050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 979a7512-64d1-4b99-bcfc-1f901b469c09 is going to be updated. [ 940.330485] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.330674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.330735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.330977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.331128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.331317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-979a7512-64d1-4b99-bcfc-1f901b469c09" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.383472] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 940.383736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.383931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.384448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.384549] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.384645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.384743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.384918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.385053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.385177] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.475303] env[65511]: INFO networking_nsxv3.common.synchronization [req-14f3789b-c46a-4a6b-a69f-39e94740ca13 req-4e70bc9e-f42f-4bb4-9898-53c25e178fe6 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 940.478560] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 940.479819] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.480139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.480293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.480701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.481071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.481307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.481557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.482030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.482249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.482465] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.798771] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.888447] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.968493] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-67 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.968816] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-67" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.969029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-67" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.969402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-67" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.969716] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.969942] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.970125] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.970441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.970692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.970942] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.971107] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.971264] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.971414] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.971576] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.971859] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.971966] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.985708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.985892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.985957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.986178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.986323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.986529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.986636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.986701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.987128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.987214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.987330] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c already deleted. [ 940.987553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.995654] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.995825] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.995944] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.996146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-67" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.996786] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-18b8f436-4e3e-49de-a937-9ee314d6f484 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.997098] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.997325] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.997807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.998513] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b8f436-4e3e-49de-a937-9ee314d6f484',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.302639] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.302639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.302639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.303227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.303227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.303227] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be created. [ 941.331706] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.331897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.331897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.332593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.332593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.342649] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: UNINITIALIZED for 2s [ 941.391736] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.501925] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.502180] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.502303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.502701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.502848] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.503010] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 18b8f436-4e3e-49de-a937-9ee314d6f484 not found, creating... [ 941.503270] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.503422] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.503533] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.503740] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.503871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.504227] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.504421] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.504535] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.504737] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.504864] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.505010] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 18b8f436-4e3e-49de-a937-9ee314d6f484 is going to be created. [ 941.528504] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.528703] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.528869] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.529138] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.529323] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.529547] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.664891] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.665097] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.665215] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.665480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.665782] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.665954] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.666563] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.666812] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.667081] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.667339] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.667497] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.667703] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.667865] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.668097] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.668214] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.668505] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.693738] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.693918] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.694058] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.694466] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.694925] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3522df0a-9d64-4440-97d2-7613447d9605 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.695172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.695343] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.695757] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.695921] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3522df0a-9d64-4440-97d2-7613447d9605',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.895984] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.896610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.896610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.896698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.896803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.896891] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be updated. [ 941.926568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.926722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.926722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.926936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.927104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.937398] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 942.199440] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.199740] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.199881] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.200223] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.200433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.200679] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3522df0a-9d64-4440-97d2-7613447d9605 not found, creating... [ 942.201111] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.201402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.201612] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.201993] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.202257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.202644] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.202821] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.202934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.203181] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.203317] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.203473] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3522df0a-9d64-4440-97d2-7613447d9605 is going to be created. [ 942.225173] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.225458] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.225605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.225972] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.226241] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.226676] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.237229] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-43cf1a94-3905-40e9-ae1e-03d1f32e5727 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 942.237528] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-43cf1a94-3905-40e9-ae1e-03d1f32e5727 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 942.237770] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-43cf1a94-3905-40e9-ae1e-03d1f32e5727 service nova] Enqueued Resource ID: 18b8f436-4e3e-49de-a937-9ee314d6f484 with Priority: HIGHEST for action port [ 942.238463] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 942.238604] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 942.238757] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b8f436-4e3e-49de-a937-9ee314d6f484 with Priority: HIGHEST for action port [ 942.239295] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.239295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.239447] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.239447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.239606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b8f436-4e3e-49de-a937-9ee314d6f484 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.239697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.239760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.239999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.240111] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b8f436-4e3e-49de-a937-9ee314d6f484',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.745461] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18b8f436-4e3e-49de-a937-9ee314d6f484 with status ACTIVE [ 942.745868] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.746229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.746229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.746490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.746633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.746907] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.747083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.747190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.747511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.747581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.748125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.748319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.748915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.748915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.748915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.748915] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18b8f436-4e3e-49de-a937-9ee314d6f484 is going to be updated. [ 942.776445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.776445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.776983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.776983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.777143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.777320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b8f436-4e3e-49de-a937-9ee314d6f484" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.020270] env[65511]: INFO networking_nsxv3.common.synchronization [req-14f3789b-c46a-4a6b-a69f-39e94740ca13 req-e0bcb2da-84b4-4590-9a5b-7630ee9634ec service nova] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 943.020469] env[65511]: INFO networking_nsxv3.common.synchronization [req-14f3789b-c46a-4a6b-a69f-39e94740ca13 req-e0bcb2da-84b4-4590-9a5b-7630ee9634ec service nova] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 943.020627] env[65511]: INFO networking_nsxv3.common.synchronization [req-14f3789b-c46a-4a6b-a69f-39e94740ca13 req-e0bcb2da-84b4-4590-9a5b-7630ee9634ec service nova] Enqueued Resource ID: 3522df0a-9d64-4440-97d2-7613447d9605 with Priority: HIGHEST for action port [ 943.021198] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_rules [ 943.021333] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 943.021529] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3522df0a-9d64-4440-97d2-7613447d9605 with Priority: HIGHEST for action port [ 943.021921] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.021989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.022467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.022752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.022865] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.024052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.024511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.024603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.024854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.025082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.025195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.025276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.025468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.025564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.025928] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.026969] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3522df0a-9d64-4440-97d2-7613447d9605 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.027111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.027219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.027411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.030167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3522df0a-9d64-4440-97d2-7613447d9605',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.271238] env[65511]: INFO networking_nsxv3.common.synchronization [req-54722c86-ed1d-4e9e-b307-6bfa2b11dce1 req-76c1ad32-e669-441f-b654-ddb9c5777664 tempest-ListServerFiltersTestJSON-1012691537 tempest-ListServerFiltersTestJSON-1012691537-project-member] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 943.271674] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGHEST for action security_group_members [ 943.271945] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.272082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.272150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.272395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.272495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.272591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.272679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.272896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.272985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.273093] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.357193] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 943.357413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.357584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.357854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.358069] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.358233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.358291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.358423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.358504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.358643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.358828] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.360026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.360292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.360502] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.360867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.360867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.360867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.361027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.361114] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.500784] env[65511]: INFO networking_nsxv3.common.synchronization [req-c3f755e4-68fc-43e3-a174-d3e1be73ef89 req-2b792a48-b1ca-4625-977c-8bbd66d58bbe tempest-ServersAdminTestJSON-2017612845 tempest-ServersAdminTestJSON-2017612845-project-member] Enqueued Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 943.501435] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f with Priority: HIGHEST for action security_group_members [ 943.501745] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d278ea-5c85-431d-b2c5-e2b81a141e5f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.501989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.502212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.502333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.502512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.502618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.502713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.502948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.503076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.503193] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d278ea-5c85-431d-b2c5-e2b81a141e5f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.535017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.535017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.535017] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.535764] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3522df0a-9d64-4440-97d2-7613447d9605 with status ACTIVE [ 943.536014] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.536135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.536204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.536477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.536536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.538403] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.538403] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.538403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.538403] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3522df0a-9d64-4440-97d2-7613447d9605 is going to be updated. [ 943.564156] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.564667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.564768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.565028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.565284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.565560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3522df0a-9d64-4440-97d2-7613447d9605" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.767870] env[65511]: INFO networking_nsxv3.common.synchronization [req-839ea21c-f02a-4ad2-a5ff-b084c2495af8 req-1d9b1933-b2af-4af2-8f4e-3e7bfe641930 tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 943.769027] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 943.769027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.769027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.769027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.770208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.770208] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.770208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.770208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.770208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.770208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.770489] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.775899] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.776024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.776078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.776323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.776437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.776682] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.776822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.776822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.777077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.777077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.777180] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be updated. [ 943.824308] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.824694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.827440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.827440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.827440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.838265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: IN_PROGRESS for 2s [ 943.864935] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.866773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.866773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.896327] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.896524] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.897650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.897650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.897650] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.897650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.897650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.898044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.898256] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.898972] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.898972] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.898972] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.898972] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.898972] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.899222] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.899397] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.920920] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.921225] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.921459] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.921722] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-621" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.922129] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-0ed98b64-6e56-44d0-9018-4add0e93de8c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.922365] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.922492] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.922815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.922951] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ed98b64-6e56-44d0-9018-4add0e93de8c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.946565] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 943.946969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.947697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.947965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.948180] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.948296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.948358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.948553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.948674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.948781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.948931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.949136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.949239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.949507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.949606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.949739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.949832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.950022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.950150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.950272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.950408] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.005171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.005330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.005403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.005685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.029784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.030071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.030191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.030256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.030497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.030593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.030739] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f is going to be updated. [ 944.040376] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.058839] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.059153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.059312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.059582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.059922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.070555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: IN_PROGRESS for 2s [ 944.240608] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9e745c5c-726c-4f75-9169-65794c2859d2 None None] Enqueued Resource ID: 1be036bd-4043-4f19-ba5c-d59fd8eb63b7 with Priority: HIGHEST for action port [ 944.241195] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be036bd-4043-4f19-ba5c-d59fd8eb63b7 with Priority: HIGHEST for action port [ 944.241543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be036bd-4043-4f19-ba5c-d59fd8eb63b7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.241710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be036bd-4043-4f19-ba5c-d59fd8eb63b7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.241803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be036bd-4043-4f19-ba5c-d59fd8eb63b7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.242100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be036bd-4043-4f19-ba5c-d59fd8eb63b7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.242211] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be036bd-4043-4f19-ba5c-d59fd8eb63b7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.273270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.273453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.273497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.273711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.273801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.274026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.274118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.274186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.274391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.274477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.274574] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 944.323026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.323026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.323026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.323026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.323026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.333983] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 944.367936] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.425737] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.426170] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.426170] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.426553] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.426713] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.426895] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 0ed98b64-6e56-44d0-9018-4add0e93de8c not found, creating... [ 944.427233] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.427426] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.427569] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.427841] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.427991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.428344] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.428518] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.428665] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.428897] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.429072] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.429242] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 0ed98b64-6e56-44d0-9018-4add0e93de8c is going to be created. [ 944.450547] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.450754] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.450845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.451117] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.451345] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.451558] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.452444] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0614801-abc8-4a0a-a4f8-e0e682a1e02c: rpc.has_security_group_logging(os_id): False [ 944.471548] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.471548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.471697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.471824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.471979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.472166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.472257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.472319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.472471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.472549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.472741] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.472834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.472892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.473074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.473148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.473359] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.473492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.473544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.473649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.473721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.473804] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be created. [ 944.545615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.545615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.545615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.545615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.545615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.545615] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c is going to be created. [ 944.588202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.588202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.588202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.588202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.588202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.601963] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.602180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.602180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.602409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.602573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.610118] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 944.612246] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: UNINITIALIZED for 2s [ 944.745088] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1be036bd-4043-4f19-ba5c-d59fd8eb63b7 [ 944.745496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.745644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.745644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.745819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.747270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.747270] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1be036bd-4043-4f19-ba5c-d59fd8eb63b7 already deleted. [ 944.747270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be036bd-4043-4f19-ba5c-d59fd8eb63b7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872283] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872858] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 944.904690] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.904856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.904904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.905136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.905279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.914675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 945.173306] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-553b04e6-7c70-4a9e-b607-23d7a3f18c76 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 945.173306] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-553b04e6-7c70-4a9e-b607-23d7a3f18c76 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 945.173306] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e9dce26-e46a-4f19-a266-7137202a37b0 req-553b04e6-7c70-4a9e-b607-23d7a3f18c76 service nova] Enqueued Resource ID: 0ed98b64-6e56-44d0-9018-4add0e93de8c with Priority: HIGHEST for action port [ 945.174070] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 945.174070] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 945.174437] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed98b64-6e56-44d0-9018-4add0e93de8c with Priority: HIGHEST for action port [ 945.174799] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.175402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.175581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.175932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.176187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ed98b64-6e56-44d0-9018-4add0e93de8c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.179612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.179612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.179612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.179612] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ed98b64-6e56-44d0-9018-4add0e93de8c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.506153] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.506543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.506543] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.506815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.507094] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.507244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.507360] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.507571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.507696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.507907] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.508050] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.508179] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.508279] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.508386] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.508634] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.508634] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.528186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.528366] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.528496] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.528751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.529066] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-937906dc-496f-481e-8241-d229c40afaa7 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.529235] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.529349] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.530140] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.530140] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('937906dc-496f-481e-8241-d229c40afaa7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.679502] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ed98b64-6e56-44d0-9018-4add0e93de8c with status ACTIVE [ 945.679755] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.679891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.679961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.680207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.680306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.680487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.680587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.680648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.680796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.680870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.681062] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.681158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.681209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.681351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.681426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.681527] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ed98b64-6e56-44d0-9018-4add0e93de8c is going to be updated. [ 945.706261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.706484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.706527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.706731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.706871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.707062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ed98b64-6e56-44d0-9018-4add0e93de8c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.820605] env[65511]: INFO networking_nsxv3.common.synchronization [req-047d65a6-5069-47cf-ab7e-97f40c93138c req-5ac838d0-b5c8-4f64-b834-48ca88ae209b tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 945.821272] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 945.821593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.821716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.821792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.821981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.823553] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.823844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.823844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.823989] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.857693] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c75da86d-70ea-4fc8-86a4-c249315ae94c in Status: SUCCESS [ 945.857909] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c deletion is rescheduled due to dependency. [ 945.858058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.032971] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.033619] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.033847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.034774] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.035149] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.035486] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 937906dc-496f-481e-8241-d229c40afaa7 not found, creating... [ 946.035844] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.036373] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.036709] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.036950] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.037406] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.037852] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.038135] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.038302] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.038983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.039305] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.039687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 937906dc-496f-481e-8241-d229c40afaa7 is going to be created. [ 946.064921] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.064921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.064921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.064921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.064921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.064921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.090658] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f in Status: SUCCESS [ 946.090658] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d278ea-5c85-431d-b2c5-e2b81a141e5f deletion is rescheduled due to dependency. [ 946.090658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d278ea-5c85-431d-b2c5-e2b81a141e5f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.183116] env[65511]: INFO networking_nsxv3.common.synchronization [None req-18a212f0-d698-4dfe-a839-9908bca961ad None None] Enqueued Resource ID: 4d1bf616-8355-40bd-a0fe-afd3e11b9908 with Priority: HIGHEST for action port [ 946.184115] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d1bf616-8355-40bd-a0fe-afd3e11b9908 with Priority: HIGHEST for action port [ 946.184115] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d1bf616-8355-40bd-a0fe-afd3e11b9908 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.184450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d1bf616-8355-40bd-a0fe-afd3e11b9908" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.184450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d1bf616-8355-40bd-a0fe-afd3e11b9908" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.184860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d1bf616-8355-40bd-a0fe-afd3e11b9908" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.184860] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d1bf616-8355-40bd-a0fe-afd3e11b9908',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.327426] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.352037] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 946.352037] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 946.352037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.624314] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: SUCCESS [ 946.624314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.624314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.624314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.624314] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.624529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.624529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.625745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.625745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.625745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.625745] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.626849] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 946.627091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.627284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.627508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.627607] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.688178] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d1bf616-8355-40bd-a0fe-afd3e11b9908 [ 946.689530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.689530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.689530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.689530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.689530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.689530] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d1bf616-8355-40bd-a0fe-afd3e11b9908 already deleted. [ 946.689530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d1bf616-8355-40bd-a0fe-afd3e11b9908" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.747617] env[65511]: INFO networking_nsxv3.common.synchronization [None req-521aa3ff-713c-413f-bcf7-994cd6c5bd2d tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 946.748730] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 946.748730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.748730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.811114] env[65511]: INFO networking_nsxv3.common.synchronization [req-839ea21c-f02a-4ad2-a5ff-b084c2495af8 req-0bc1902f-52db-4ae5-be51-9969f44ebce3 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 946.811114] env[65511]: INFO networking_nsxv3.common.synchronization [req-839ea21c-f02a-4ad2-a5ff-b084c2495af8 req-0bc1902f-52db-4ae5-be51-9969f44ebce3 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 946.811114] env[65511]: INFO networking_nsxv3.common.synchronization [req-839ea21c-f02a-4ad2-a5ff-b084c2495af8 req-0bc1902f-52db-4ae5-be51-9969f44ebce3 service nova] Enqueued Resource ID: 937906dc-496f-481e-8241-d229c40afaa7 with Priority: HIGHEST for action port [ 946.811114] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 946.811551] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 946.811853] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 937906dc-496f-481e-8241-d229c40afaa7 with Priority: HIGHEST for action port [ 946.812468] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.812860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.813138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.813547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.813806] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.815457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.815766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.816021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.816497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.816786] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.818204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.818204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.818204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.818204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.818204] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.819099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-937906dc-496f-481e-8241-d229c40afaa7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.819401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.819580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.819857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.820048] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('937906dc-496f-481e-8241-d229c40afaa7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.831161] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.925193] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 946.925276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.925430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.925896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.925896] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.926075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.926075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.926903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.926903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.926903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.926903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.926903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.926903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.927151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.927559] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.927776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.927887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.928563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.928563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.928563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.928563] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.929550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.929879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.930159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.930339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.930464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.930698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.930834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.930981] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.129435] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.130580] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.131702] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.131702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.132242] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.320062] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.326836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.326836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 937906dc-496f-481e-8241-d229c40afaa7 with status ACTIVE [ 947.326836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.326836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.326836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.326836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.327316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.327316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.331233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.331364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.331416] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 937906dc-496f-481e-8241-d229c40afaa7 is going to be updated. [ 947.333150] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.333834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.333834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.333834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.333834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.334190] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 947.362038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.362038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.362038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.362038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.362038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.362327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-937906dc-496f-481e-8241-d229c40afaa7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.370615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.371208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.371208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.371208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.371324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.385243] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 947.432963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a82020c-f023-4af6-a870-9b8623205ed1: rpc.has_security_group_logging(os_id): False [ 947.434275] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.456154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.456359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.456446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.456667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.456838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.456962] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.457238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.457334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.457535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.457658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.457953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.458100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.458189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.458376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.458479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.458707] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.461766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.461766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.461766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.461766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.461766] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be created. [ 947.553508] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.553690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.553732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.553923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.554118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.565836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 947.634049] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2777b4e0-28a1-4987-85d5-9f30569a8c3c: rpc.has_security_group_logging(os_id): False [ 947.635069] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.635241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.635332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.635568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.635760] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.636484] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.636484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.636768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.636811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.636969] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.637100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.637189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.637362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.637874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.637874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.637874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.656126] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.656297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.656391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.656598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.656682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.656953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.657083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.657143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.657297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.657375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.657461] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c is going to be created. [ 947.740720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.740720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.740720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.740720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.740720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.751923] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: IN_PROGRESS for 2s [ 947.833445] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.938523] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.141898] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0614801-abc8-4a0a-a4f8-e0e682a1e02c: rpc.has_security_group_logging(os_id): False [ 948.164303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.164303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.164303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.164303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.164303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.164303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.164710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.164710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.165118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.165220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.165459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.165565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.165628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.165774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.165884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.166060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.166155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.166216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.166487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.166487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.166574] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be updated. [ 948.231070] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.231070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.231070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.231070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.231315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.268249] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 948.340165] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.340334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.340425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.340636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.340733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.340832] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 948.390588] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.390588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.390588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.390787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.390994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.400980] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 948.439805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.440011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.440096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.441009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.441009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.441009] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 948.484135] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.484135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.484253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.484687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.484687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.494506] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 948.706046] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8d019d0c-b187-439f-9b11-9083467341d3 tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 948.706142] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 948.707063] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.707063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.707063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.707435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.707560] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.832282] env[65511]: INFO networking_nsxv3.common.synchronization [req-375e7c17-b569-4105-a467-f155188e2752 req-f3c55b21-0cf1-4690-815b-eedfdfbbc0f9 tempest-ServersTestManualDisk-1702256595 tempest-ServersTestManualDisk-1702256595-project-member] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 948.832901] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 948.833932] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.834473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.834473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.834635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.835365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.835515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.835584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.835974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.835974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.835974] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.172719] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5b63136d-5e6a-4aac-93c6-e85fe929d486 None None] Enqueued Resource ID: 429696e5-9cbc-4b59-a078-d5870e1c2f2d with Priority: HIGHEST for action port [ 949.174828] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429696e5-9cbc-4b59-a078-d5870e1c2f2d with Priority: HIGHEST for action port [ 949.174828] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-429696e5-9cbc-4b59-a078-d5870e1c2f2d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.174828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429696e5-9cbc-4b59-a078-d5870e1c2f2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.174828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429696e5-9cbc-4b59-a078-d5870e1c2f2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.174828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429696e5-9cbc-4b59-a078-d5870e1c2f2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.174828] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429696e5-9cbc-4b59-a078-d5870e1c2f2d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.229348] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9a5f57c3-b8c3-41e9-a85e-ce98c8c281cf tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 949.230079] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 949.232015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.232157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.232228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.232485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.232580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.232695] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce already deleted. [ 949.232787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.233147] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.233256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.233326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.233854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.233854] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.338920] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.339180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.339251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.339469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.339562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.339763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.339866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.339948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.340086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.340174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.340259] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee already deleted. [ 949.340339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.397483] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 949.397713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.397878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.398129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.398326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.398444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.398531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.398703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.398779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.398874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.520026] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.520238] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-758" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.520377] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-758" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.520681] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-758" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.520965] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.521129] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.521254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.521471] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.521612] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.521817] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.521926] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.522045] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.522150] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.522256] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.522361] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.522499] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.541658] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.541829] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.541960] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.542154] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-758" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.542467] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-6089173e-ed01-4cf2-8979-1bb065090c42 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.542636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.542751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.543094] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.543229] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089173e-ed01-4cf2-8979-1bb065090c42',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.580042] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 949.580335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.580605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.580829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.580921] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.679046] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 429696e5-9cbc-4b59-a078-d5870e1c2f2d [ 949.679046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.679046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.679046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.679046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.679046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.679046] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:429696e5-9cbc-4b59-a078-d5870e1c2f2d already deleted. [ 949.679046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429696e5-9cbc-4b59-a078-d5870e1c2f2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.757841] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.759755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.759755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.759755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.759755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.759755] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce already deleted. [ 949.759755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.768124] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: SUCCESS [ 949.768124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.901141] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.901396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.901466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.901659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.901723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.901990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.902190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.902190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.902389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.902477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.902601] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 949.933722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.933921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.933966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.934181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.934339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.945454] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 950.046072] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.046292] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.046495] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.047336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.047618] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.047787] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 6089173e-ed01-4cf2-8979-1bb065090c42 not found, creating... [ 950.048061] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.048219] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.048334] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.048592] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.048764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.049112] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.049306] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.049392] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.049601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.049732] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.049868] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 6089173e-ed01-4cf2-8979-1bb065090c42 is going to be created. [ 950.070011] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.070192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.070309] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.070584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.070811] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.071041] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.086759] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.086887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.292570] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 950.292863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.412591] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.412591] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.412591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.413088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.413088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.413088] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.508607] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 950.509069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.509154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.509350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.509804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.509960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.509960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.510508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.510508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.510508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.510508] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.784379] env[65511]: INFO networking_nsxv3.common.synchronization [req-375e7c17-b569-4105-a467-f155188e2752 req-a05dda67-d416-4fe3-bbd5-6cb82cf87431 service nova] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 950.784590] env[65511]: INFO networking_nsxv3.common.synchronization [req-375e7c17-b569-4105-a467-f155188e2752 req-a05dda67-d416-4fe3-bbd5-6cb82cf87431 service nova] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 950.784731] env[65511]: INFO networking_nsxv3.common.synchronization [req-375e7c17-b569-4105-a467-f155188e2752 req-a05dda67-d416-4fe3-bbd5-6cb82cf87431 service nova] Enqueued Resource ID: 6089173e-ed01-4cf2-8979-1bb065090c42 with Priority: HIGHEST for action port [ 950.785309] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_rules [ 950.785447] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 950.785595] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6089173e-ed01-4cf2-8979-1bb065090c42 with Priority: HIGHEST for action port [ 950.785891] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.786063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.786114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.786443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.786595] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.788289] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.788436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.788509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.788734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.788907] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.789010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.789145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.789342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.789436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.789530] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.790433] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6089173e-ed01-4cf2-8979-1bb065090c42 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.790537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.790610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.790770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.790848] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089173e-ed01-4cf2-8979-1bb065090c42',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.914984] env[65511]: INFO networking_nsxv3.common.synchronization [None req-eda89de7-597e-4620-aec5-9a0f24823ca7 None None] Enqueued Resource ID: 3cc20b48-a642-44ff-8535-8320894d3a2d with Priority: HIGHEST for action port [ 950.915111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.915210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.915271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.916849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.916849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.916849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.916849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.916849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.916849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.919162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.919383] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.919696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.920073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.920073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.921294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.921658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.921658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.921658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.921743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.921868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.922081] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.923875] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc20b48-a642-44ff-8535-8320894d3a2d with Priority: HIGHEST for action port [ 950.927194] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc20b48-a642-44ff-8535-8320894d3a2d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.927342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc20b48-a642-44ff-8535-8320894d3a2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.927431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc20b48-a642-44ff-8535-8320894d3a2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.927731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc20b48-a642-44ff-8535-8320894d3a2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.927836] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc20b48-a642-44ff-8535-8320894d3a2d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.014663] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.014663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.014897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.014972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.015274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.015599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.015680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.015874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.015964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.016095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.016294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.016595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.016698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.016862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.017065] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.017198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.017294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.017687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.017773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.017858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.017945] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.296064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.296064] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.296064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6089173e-ed01-4cf2-8979-1bb065090c42 with status ACTIVE [ 951.296064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.296064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.296064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.297127] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.297127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.297127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.298933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.299216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.299469] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6089173e-ed01-4cf2-8979-1bb065090c42 is going to be updated. [ 951.327833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.327833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.327833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.327833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.327833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.327833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6089173e-ed01-4cf2-8979-1bb065090c42" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.427208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 951.432024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc20b48-a642-44ff-8535-8320894d3a2d [ 951.432024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.432024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.432024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.432024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.432024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.432024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc20b48-a642-44ff-8535-8320894d3a2d already deleted. [ 951.432423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc20b48-a642-44ff-8535-8320894d3a2d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.452486] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.452690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.452690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.452902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.452995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.453232] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.453324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.453390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.453541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.453613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.453925] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.454029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.454029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.454665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.454665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.454665] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.454665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.454665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.454949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.454949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.454949] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 951.519561] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a82020c-f023-4af6-a870-9b8623205ed1: rpc.has_security_group_logging(os_id): False [ 951.523917] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.523917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.523917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.524341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.524341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.539189] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 951.545731] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.545877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.545941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.546637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.546765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.546909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.547063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.547175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.547368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.547463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.547711] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.547803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.547864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.548048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.548137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.548323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.548843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.548843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.548843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.548843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.548843] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 951.654747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.655300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.655300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.655735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.655735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.670024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 951.802514] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.957936] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 951.958518] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 deletion is rescheduled due to dependency. [ 951.958667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.292210] env[65511]: INFO networking_nsxv3.common.synchronization [req-ba466ee9-3a7f-4ebd-ac68-511f182339dd req-dff86379-a19a-4ce7-a4ab-cde29a84d9e4 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 952.293123] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGHEST for action security_group_members [ 952.297651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.301632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.301632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.301632] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.305230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.305575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.305835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.306201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.306453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.306664] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee is going to be created. [ 952.344446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.344446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.344446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.344446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.344446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.356669] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: UNINITIALIZED for 2s [ 952.802711] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.802711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.802880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.803278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.803278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.803369] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.803466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.803544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.803736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.803821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.803900] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 is going to be updated. [ 952.834141] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.834328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.834370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.835317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.835317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.850487] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: IN_PROGRESS for 2s [ 953.563507] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 953.563897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.697643] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 953.697881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.698276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.698607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.698769] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.210078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.210078] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.210078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.210078] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.372263] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: SUCCESS [ 954.372500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.372701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.372929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.373159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.373293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.373456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.373487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.373629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.373729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.373824] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.712258] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.712660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.712660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.712896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.713116] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.713833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.713833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.713833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.713833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.713833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.714527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.714527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.714527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.714656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.714782] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.714973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.715080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.715253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.715667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.715667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.715667] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.863115] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 in Status: SUCCESS [ 954.863567] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 deletion is rescheduled due to dependency. [ 954.863567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.875956] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.219745] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a82020c-f023-4af6-a870-9b8623205ed1: rpc.has_security_group_logging(os_id): False [ 955.241197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.241197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.241197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.241619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.241619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.241619] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.241717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.241746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.241936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.242528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.242843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.243534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.243716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.243981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.244368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.245013] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 955.329675] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.330145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.330272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.330544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.330760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.350299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 955.378827] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab4de9da-a8ca-4370-af21-e316dc775aee: rpc.has_security_group_logging(os_id): False [ 955.402543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.402743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.402910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.403853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.403853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.403853] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.403853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.403853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.404319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.404319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.404319] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee is going to be created. [ 955.527320] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.527320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.527320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.527320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.527320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.543465] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: IN_PROGRESS for 2s [ 955.624371] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c7db02e7-74e7-489b-818b-d6116d9bb989 None None] Enqueued Resource ID: 8cb1b721-9814-4281-8d9e-cd7cc6bf87c5 with Priority: HIGHEST for action port [ 955.625848] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb1b721-9814-4281-8d9e-cd7cc6bf87c5 with Priority: HIGHEST for action port [ 955.626573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cb1b721-9814-4281-8d9e-cd7cc6bf87c5 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.626740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cb1b721-9814-4281-8d9e-cd7cc6bf87c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.626740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cb1b721-9814-4281-8d9e-cd7cc6bf87c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.627378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cb1b721-9814-4281-8d9e-cd7cc6bf87c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.627378] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cb1b721-9814-4281-8d9e-cd7cc6bf87c5',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.130570] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cb1b721-9814-4281-8d9e-cd7cc6bf87c5 [ 956.130997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.131243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.131243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.131546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.131676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.131833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cb1b721-9814-4281-8d9e-cd7cc6bf87c5 already deleted. [ 956.131958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cb1b721-9814-4281-8d9e-cd7cc6bf87c5" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.370809] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 957.371628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.559969] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: SUCCESS [ 957.559969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.915047] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c52a7737-1a36-46bd-9a14-12b825a48fe9 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 957.916752] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 957.917409] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.917541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.917541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.918401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.918401] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.176689] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8234acea-13b7-40e4-983f-c5976e1a1a61 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 958.177378] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 958.177551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.177632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.408456] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f15267ab-221e-4071-8b63-d6ab50bf7fa2 None None] Enqueued Resource ID: 05c41000-5226-4dbe-8cd4-485cbe6b766a with Priority: HIGHEST for action port [ 958.409391] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c41000-5226-4dbe-8cd4-485cbe6b766a with Priority: HIGHEST for action port [ 958.409952] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-05c41000-5226-4dbe-8cd4-485cbe6b766a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.410117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05c41000-5226-4dbe-8cd4-485cbe6b766a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.410186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05c41000-5226-4dbe-8cd4-485cbe6b766a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.410459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05c41000-5226-4dbe-8cd4-485cbe6b766a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.410546] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c41000-5226-4dbe-8cd4-485cbe6b766a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.444875] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.444875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.444875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.444875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.444875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.444875] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 already deleted. [ 958.444875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.445307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.445307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.445307] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.916237] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05c41000-5226-4dbe-8cd4-485cbe6b766a [ 958.916921] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.917081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.917217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.917644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.917853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.918104] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05c41000-5226-4dbe-8cd4-485cbe6b766a already deleted. [ 958.918293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05c41000-5226-4dbe-8cd4-485cbe6b766a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.967641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.967810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.967881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.968156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.968798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.968798] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 already deleted. [ 958.968798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.220525] env[65511]: INFO networking_nsxv3.common.synchronization [req-58d0e287-6255-41f8-9926-e1894e6b0148 req-22bdf4ea-78ed-44cb-b021-9cb37b261f85 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 963.221109] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 963.221434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.221557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.221632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.221827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.221980] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.222483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.222483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.222637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.222727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.222843] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.725723] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.725931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.725931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.726528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.726528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.726702] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.726702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.726791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.726964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.727023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.727117] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 963.778342] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.778571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.778688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.779089] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.780182] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.780608] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.781944] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.781944] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.781944] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.781944] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.781944] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.781944] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.781944] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.781944] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.781944] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.782298] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.784593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.784792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.785139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.785773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.786359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.807400] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 963.828896] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.829293] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.829293] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.830130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.830130] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.830130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.830130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.831057] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.831057] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65bd898c-a00e-4f25-a151-f9a0b51aa4d7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.336511] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.337111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.337111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.337432] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.337640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.337848] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 not found, creating... [ 964.338213] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.338425] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.338601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.338907] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.339326] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.340264] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.340264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.340264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.340264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.340437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.340641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 is going to be created. [ 964.364635] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.364917] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.365056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.365387] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.365667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.366025] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492750] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8d1c9b30-6efb-46ae-9f1f-f9152a0f8527 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 964.493384] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 964.493734] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.493923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.494066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.494400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.494522] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.030568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.030771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.030843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.031146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.031218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.031254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2505d7-9740-4169-97c7-e850756cca9e already deleted. [ 965.031338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.115246] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ab13fd5f-9a39-4974-93b3-63b78b5729e1 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 965.116141] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 965.118210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.118347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.118600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.118667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.118795] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.126177] env[65511]: INFO networking_nsxv3.common.synchronization [req-58d0e287-6255-41f8-9926-e1894e6b0148 req-f00d4fd0-0037-4732-aa51-e945a433c06f service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 965.126353] env[65511]: INFO networking_nsxv3.common.synchronization [req-58d0e287-6255-41f8-9926-e1894e6b0148 req-f00d4fd0-0037-4732-aa51-e945a433c06f service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 965.126521] env[65511]: INFO networking_nsxv3.common.synchronization [req-58d0e287-6255-41f8-9926-e1894e6b0148 req-f00d4fd0-0037-4732-aa51-e945a433c06f service nova] Enqueued Resource ID: 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 with Priority: HIGHEST for action port [ 965.127151] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 965.127318] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 965.127447] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 with Priority: HIGHEST for action port [ 965.127732] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.127836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.127935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.128121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.128206] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.129603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.129717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.130063] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.130177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.130241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.130437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.130518] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65bd898c-a00e-4f25-a151-f9a0b51aa4d7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.362579] env[65511]: INFO networking_nsxv3.common.synchronization [req-8898ac22-c12b-4aee-96c1-a308b228bf9b req-4f9c757e-4ea4-4a57-9614-f964f85b3bf6 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 965.364021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 965.366198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.366198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.366198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.366198] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.630657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.630818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.635504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 with status ACTIVE [ 965.636398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.636398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.636398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.636398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.636398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.636398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.636756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.636756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.636890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.636934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.637124] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.637207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.637309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.637557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.637557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.637938] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65bd898c-a00e-4f25-a151-f9a0b51aa4d7 is going to be updated. [ 965.639619] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.639733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.639733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.640023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.640023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.640144] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2505d7-9740-4169-97c7-e850756cca9e already deleted. [ 965.640144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.660457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.660678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.660678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.660871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.661864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.661864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65bd898c-a00e-4f25-a151-f9a0b51aa4d7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.825186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 965.825828] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 965.826553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.826670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.827034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.827791] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.827791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.827949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.828283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.828568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.828717] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.868952] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.164378] env[65511]: INFO networking_nsxv3.common.synchronization [req-8898ac22-c12b-4aee-96c1-a308b228bf9b req-45b16583-49a4-4db3-80f1-f472eca5d93a tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 966.167307] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 966.167307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.167307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.332942] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.371842] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.519324] env[65511]: INFO networking_nsxv3.common.synchronization [req-8898ac22-c12b-4aee-96c1-a308b228bf9b req-4ad4f283-22c1-43f5-b5b5-a8f1d0a4a47b tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 966.521421] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 966.521808] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.521905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.838097] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.876571] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.876741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.876814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.877054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.877151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.877252] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 966.921369] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.921369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.921369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.921369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.921369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.932933] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 967.341570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.341877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.342029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.342519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.342708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.342883] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 967.385638] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.386054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.386054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.386246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.386357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.402887] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 967.561319] env[65511]: INFO networking_nsxv3.common.synchronization [req-c9dfa4d0-e5b0-4ee7-ae05-f7733405dfbf req-52c81f7d-12d8-47a6-ab6a-7dc9f99d05aa tempest-ServerDiagnosticsTest-1427076355 tempest-ServerDiagnosticsTest-1427076355-project-member] Enqueued Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 967.561891] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 967.562901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.562901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.563115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.563311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.563866] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.563866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.563866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.565409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.565409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.565409] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.067422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.067593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.067681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.067856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.067932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.068136] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.068227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.068284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.068492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.068607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.068731] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a already deleted. [ 968.068959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.082735] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.082940] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.083418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.083501] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.083805] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.084041] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.084190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.084446] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.084640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.085309] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.085309] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.085309] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.085434] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.085577] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.085660] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.085815] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.112575] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.112575] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.112575] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.112575] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-772" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.112575] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.112575] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.112575] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.112575] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.112575] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e98a39-85eb-4b6b-87fe-e660b2bc7eef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.613234] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.613537] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.613583] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.613861] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.613998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.614164] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 38e98a39-85eb-4b6b-87fe-e660b2bc7eef not found, creating... [ 968.614464] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.614627] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.614751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.615012] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.617753] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.618140] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.618312] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.618419] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.618642] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.618811] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.618987] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 38e98a39-85eb-4b6b-87fe-e660b2bc7eef is going to be created. [ 968.639889] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.641564] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.641808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.642135] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.642369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.642604] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.946052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 968.946252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.946606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.946752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.947221] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.947221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.947221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.947819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.947819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.947819] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.387389] env[65511]: INFO networking_nsxv3.common.synchronization [req-c9dfa4d0-e5b0-4ee7-ae05-f7733405dfbf req-15ac1eb7-a02a-4390-b97f-ae65ae8f1368 service nova] Enqueued Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_rules [ 969.387389] env[65511]: INFO networking_nsxv3.common.synchronization [req-c9dfa4d0-e5b0-4ee7-ae05-f7733405dfbf req-15ac1eb7-a02a-4390-b97f-ae65ae8f1368 service nova] Enqueued Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 969.387389] env[65511]: INFO networking_nsxv3.common.synchronization [req-c9dfa4d0-e5b0-4ee7-ae05-f7733405dfbf req-15ac1eb7-a02a-4390-b97f-ae65ae8f1368 service nova] Enqueued Resource ID: 38e98a39-85eb-4b6b-87fe-e660b2bc7eef with Priority: HIGHEST for action port [ 969.388064] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_rules [ 969.388155] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 969.388199] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38e98a39-85eb-4b6b-87fe-e660b2bc7eef with Priority: HIGHEST for action port [ 969.388513] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.388606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.388670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.389101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.389191] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.390392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.390392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.390569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.390832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.390832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.390912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.390974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.391259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.391412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.391412] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.393305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.393305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.393305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.393305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.393573] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38e98a39-85eb-4b6b-87fe-e660b2bc7eef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.416026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.416026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.416026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.416026] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.450562] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.450714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.450783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.452053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.452053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.452053] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 969.490430] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.490591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.490667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.491502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.491683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.504890] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 969.834795] env[65511]: INFO networking_nsxv3.common.synchronization [req-b381f062-5b6a-40db-871c-4b4c92e6ffa0 req-ce17fa10-a151-4266-8818-784e4c58be66 tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 969.835401] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 969.836469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.836632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.836692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.836902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.837118] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.837614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.837702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.837893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.837985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.838095] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.895144] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.895335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.897159] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.897159] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38e98a39-85eb-4b6b-87fe-e660b2bc7eef with status ACTIVE [ 969.897159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.897159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.897159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.897468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.897565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.897770] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.901623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.901712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.904075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.904222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.904454] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.904563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.904625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.904798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.904875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.904963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38e98a39-85eb-4b6b-87fe-e660b2bc7eef is going to be updated. [ 969.906766] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.918174] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.918418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.918476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.918652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.918836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.918946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.919029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.919228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.919349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.919473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.919702] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.919813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.919874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.920054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.920216] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.920321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.920383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.920613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.920761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.920855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.920957] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.931996] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.931996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.932223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.932305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.932973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.932973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38e98a39-85eb-4b6b-87fe-e660b2bc7eef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.341053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.341277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.341322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.341676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.374226] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1c2c486d-2dea-4395-a15b-a12badd0d8a5 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 970.375971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.376342] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.376568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.376630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.376912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.377043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.377310] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 970.379609] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 970.379792] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.379952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.380052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.380405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.380561] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.411723] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.411723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.411723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.411723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.411723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.411723] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a is going to be created. [ 970.422027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.422027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.422027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.422027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.422027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.422681] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 970.432450] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 970.449025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.449025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.449025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.449025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.449025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.451171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.451510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.451718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.452067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.452313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.452681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.453432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.453432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.453432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.453432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.455069] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.455069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.455069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.455069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.455069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.455069] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.455069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.455423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.455576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.455576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.455732] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 970.466811] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: UNINITIALIZED for 2s [ 970.525926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.526103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.526174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.526383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.526599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.544752] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 970.575603] env[65511]: INFO networking_nsxv3.common.synchronization [req-9b50620a-3331-471f-9f87-4b1f604af9f7 req-b8625e70-5ba0-4228-a0ae-90aeee32d417 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 970.576167] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 970.576499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.576636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.576726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.576966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.582030] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.582030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.582030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.582030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.582030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.582030] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.775977] env[65511]: INFO networking_nsxv3.common.synchronization [None req-820855e7-1328-4079-a073-b1073eb424df tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 970.776591] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 970.776919] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.777461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.910098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.910591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.910591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.910680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.910821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.910992] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 already deleted. [ 970.911170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.911893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.912858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.913053] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.070139] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.070139] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.070139] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.070139] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.070139] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.070139] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.070139] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.070970] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.070970] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.070970] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.081888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.082328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.082445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.082702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.083554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.083707] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.084879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.084879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.084879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.084879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.084879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 already deleted. [ 971.084879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.100102] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.100102] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.100102] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.100102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.100102] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4519455b-2754-4c2f-9d7d-d51423bc24e3 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.100102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.100102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.100102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.100102] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4519455b-2754-4c2f-9d7d-d51423bc24e3',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.433630] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.433786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.433848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.434145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.434232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.434265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 already deleted. [ 971.434422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.516435] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 971.516821] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 deletion is rescheduled due to dependency. [ 971.516961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.517167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.517406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.517730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.517836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.517836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.517987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.518131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.518197] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.602694] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.602922] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.603057] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.603345] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.603491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.603785] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4519455b-2754-4c2f-9d7d-d51423bc24e3 not found, creating... [ 971.603901] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.604677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.604677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.604677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.604677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.604903] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.604960] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.605613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.605925] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.606130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.606400] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4519455b-2754-4c2f-9d7d-d51423bc24e3 is going to be created. [ 971.630641] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.630849] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.630967] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.631349] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.631619] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.631878] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.021476] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.023661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.023661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.023830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.023877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.024133] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.024261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.024331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.025029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.025029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.025029] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 972.028180] env[65511]: INFO networking_nsxv3.common.synchronization [None req-4d16da3a-372e-4c69-8e5f-208fb9ff209b None None] Enqueued Resource ID: 6614e8c4-0994-4259-8a1a-383728e42595 with Priority: HIGHEST for action port [ 972.029486] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6614e8c4-0994-4259-8a1a-383728e42595 with Priority: HIGHEST for action port [ 972.029624] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6614e8c4-0994-4259-8a1a-383728e42595 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.029730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6614e8c4-0994-4259-8a1a-383728e42595" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.029787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6614e8c4-0994-4259-8a1a-383728e42595" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.030037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6614e8c4-0994-4259-8a1a-383728e42595" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.031031] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6614e8c4-0994-4259-8a1a-383728e42595',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.055158] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.055660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.055660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.055660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.055874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.065779] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 972.358917] env[65511]: INFO networking_nsxv3.common.synchronization [req-9b50620a-3331-471f-9f87-4b1f604af9f7 req-aaf80eff-64d3-4202-9b3e-d076f7a332ea service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 972.359116] env[65511]: INFO networking_nsxv3.common.synchronization [req-9b50620a-3331-471f-9f87-4b1f604af9f7 req-aaf80eff-64d3-4202-9b3e-d076f7a332ea service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 972.359273] env[65511]: INFO networking_nsxv3.common.synchronization [req-9b50620a-3331-471f-9f87-4b1f604af9f7 req-aaf80eff-64d3-4202-9b3e-d076f7a332ea service nova] Enqueued Resource ID: 4519455b-2754-4c2f-9d7d-d51423bc24e3 with Priority: HIGHEST for action port [ 972.359966] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 972.360124] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 972.360223] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4519455b-2754-4c2f-9d7d-d51423bc24e3 with Priority: HIGHEST for action port [ 972.360831] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.360968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.361050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.361321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.361408] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.362896] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.363025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.363573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.363573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.363573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.363573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.363573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.363974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.363974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.363974] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.364703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4519455b-2754-4c2f-9d7d-d51423bc24e3 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.364834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.364897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.365038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.365114] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4519455b-2754-4c2f-9d7d-d51423bc24e3',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.444197] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 972.444401] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 deletion is rescheduled due to dependency. [ 972.444533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.479030] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: SUCCESS [ 972.479030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.479190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.479334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.479554] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.479676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.479732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.479996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.479996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.480160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.480160] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.532973] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6614e8c4-0994-4259-8a1a-383728e42595 [ 972.533219] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.533359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.533428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.533656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.533744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.533841] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6614e8c4-0994-4259-8a1a-383728e42595 already deleted. [ 972.533923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6614e8c4-0994-4259-8a1a-383728e42595" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.563818] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 972.564052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.864010] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.864492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.867987] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4519455b-2754-4c2f-9d7d-d51423bc24e3 with status ACTIVE [ 972.868586] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.868939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.869192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.870211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.870404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.870708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.870948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.871196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.871416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.871531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.871819] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.872084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.872356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.872580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.872736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.872944] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4519455b-2754-4c2f-9d7d-d51423bc24e3 is going to be updated. [ 972.874619] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.904291] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.904513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.904599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.904747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.904888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.905071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4519455b-2754-4c2f-9d7d-d51423bc24e3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.945113] env[65511]: INFO networking_nsxv3.common.synchronization [req-eeb26bc6-a3bb-4a42-8dd5-6998057c30c7 req-455e29e6-1412-4bf3-aa1b-281b1415ee77 tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 972.945432] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 972.945747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.945874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.945941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.946229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.946428] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.946625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.946688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.946872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.946959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.947277] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.983228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.983539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.983539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.983857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.984069] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.984353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.984353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.984512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.984639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.984849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.985077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.985204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.985280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.985432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.985649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.985791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.985887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.988212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.988336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.988429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.988531] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.362638] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.362941] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.363116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.363393] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.363701] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.363884] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.364134] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.364402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.364584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.364791] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.364952] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.365047] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.365193] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.365329] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.365474] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.365636] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.380386] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.394067] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.394067] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.394217] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.394857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.394857] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.395044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.395044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.395696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.395696] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.449664] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.449664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.449664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.449664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.449664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.449926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.449926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.449926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.450048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.450133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.450299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce already deleted. [ 973.450299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.492714] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55791d1b-680e-4037-89f2-4b3bac998f5a: rpc.has_security_group_logging(os_id): False [ 973.519407] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.519666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.519666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.520010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.520010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.520225] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.520366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.520435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.520609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.520691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.520891] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.520988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.521073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.521202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.521272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.521465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.521555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.521607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.521740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.521842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.521913] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a is going to be created. [ 973.602381] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.602381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.602381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.602381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.602381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.619060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: IN_PROGRESS for 2s [ 973.883614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.883614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.883614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.883614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.883936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.883936] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be created. [ 973.900071] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.900390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.900585] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.900978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.901203] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.901444] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 not found, creating... [ 973.901874] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.902140] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.902244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.902906] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.902906] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.903225] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.903466] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.903637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.903964] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.904164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.904389] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 is going to be created. [ 973.933601] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.934176] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.934176] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.934411] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.934831] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.934921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.936704] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.936842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.936906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.937138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.937296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.956700] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: UNINITIALIZED for 2s [ 974.080143] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 974.080401] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 deletion is rescheduled due to dependency. [ 974.080491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.697524] env[65511]: INFO networking_nsxv3.common.synchronization [None req-82c67868-2fd9-44d1-9a62-550cf964eefb None None] Enqueued Resource ID: 08e04fb5-a2ef-4e7d-ba85-7092453a1349 with Priority: HIGHEST for action port [ 974.699988] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08e04fb5-a2ef-4e7d-ba85-7092453a1349 with Priority: HIGHEST for action port [ 974.699988] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-08e04fb5-a2ef-4e7d-ba85-7092453a1349 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.699988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08e04fb5-a2ef-4e7d-ba85-7092453a1349" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.699988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08e04fb5-a2ef-4e7d-ba85-7092453a1349" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.699988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08e04fb5-a2ef-4e7d-ba85-7092453a1349" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.699988] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08e04fb5-a2ef-4e7d-ba85-7092453a1349',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.716161] env[65511]: INFO networking_nsxv3.common.synchronization [req-eeb26bc6-a3bb-4a42-8dd5-6998057c30c7 req-4e547abd-9bdb-4ddb-bcb8-b105cce37af7 service nova] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 974.717433] env[65511]: INFO networking_nsxv3.common.synchronization [req-eeb26bc6-a3bb-4a42-8dd5-6998057c30c7 req-4e547abd-9bdb-4ddb-bcb8-b105cce37af7 service nova] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 974.717630] env[65511]: INFO networking_nsxv3.common.synchronization [req-eeb26bc6-a3bb-4a42-8dd5-6998057c30c7 req-4e547abd-9bdb-4ddb-bcb8-b105cce37af7 service nova] Enqueued Resource ID: 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 with Priority: HIGHEST for action port [ 974.719500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_rules [ 974.719500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 974.719500] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 with Priority: HIGHEST for action port [ 974.719500] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.719500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.720317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.720613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.720745] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.721854] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722884] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.723194] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.727372] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.727372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.727372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.727372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.727372] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.202718] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08e04fb5-a2ef-4e7d-ba85-7092453a1349 [ 975.202979] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.203137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.203210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.203451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.203542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.203641] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08e04fb5-a2ef-4e7d-ba85-7092453a1349 already deleted. [ 975.203756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08e04fb5-a2ef-4e7d-ba85-7092453a1349" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.226962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.227411] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.227519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.228406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 with status ACTIVE [ 975.228406] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.228406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.228406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.228671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.228671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.228743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.228792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.228827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.228981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.232186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.232186] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.232186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.232186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.232186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.232186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.232186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2 is going to be updated. [ 975.257656] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.257847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.257950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.258281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.258443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ea98cab-ed6b-45cd-bcd4-afc58ac5e2e2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.634131] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: SUCCESS [ 975.634377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.729397] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.974038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.974038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.974038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.974038] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.234154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.234154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.234154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.234154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.234154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.234154] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce is going to be created. [ 976.270274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.270489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.270489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.270676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.270827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.282597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: UNINITIALIZED for 2s [ 976.476430] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.477103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.477228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.477437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.477607] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.477716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.477788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.477961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.478085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.478139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.478290] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.478384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.478439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.478583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.478770] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.478841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.478900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.479048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.480566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.480566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.480566] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.982837] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 751af4d7-7958-43dc-a40b-b5e3493c4166: rpc.has_security_group_logging(os_id): False [ 977.006767] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.007031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.007131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.007368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.007455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.007807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.007919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.008024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.008236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.008369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.008721] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.008799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.008881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.009775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.009895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.010198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.010312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.010378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.010554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.010691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.010783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be created. [ 977.115734] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.115734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.115734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.115993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.117852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.128953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 977.325068] env[65511]: INFO networking_nsxv3.common.synchronization [req-29107b17-8a71-4c92-8cbf-f80081df31e5 req-1769e313-ae9b-4543-b613-fe3da1dc8adf tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 977.328312] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 977.329259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.331229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.331381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.331719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.331997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.520074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.520248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.520683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.520831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.521100] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.752607] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.752607] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.752607] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.756021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.756021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.756021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.756021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.756021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.756021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.756021] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.756021] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.756021] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.756021] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.756021] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.756021] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.756021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.780161] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.780870] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.781196] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.781643] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.782328] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-84305d27-a359-4cf2-bb40-3aa05cd9277b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.783155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.783489] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.783971] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.785473] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84305d27-a359-4cf2-bb40-3aa05cd9277b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.024534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.024907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.024907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.024997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.025087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.025319] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.025424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.025757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.025757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.025757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.025935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22614963-faca-462c-8364-ac7ae98c2969 already deleted. [ 978.025935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.287469] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.287876] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.288023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.288342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.288491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.288647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 84305d27-a359-4cf2-bb40-3aa05cd9277b not found, creating... [ 978.289101] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.289688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.289911] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.290866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.291221] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.291642] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.291758] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.292584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.292584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.292584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.292584] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b is going to be created. [ 978.314121] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: SUCCESS [ 978.314361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.314563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.314805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.315020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.315140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.315203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.315401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.315537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.315651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.315758] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.333254] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.333530] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.333671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.333957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.334218] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.334463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.818460] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.139189] env[65511]: INFO networking_nsxv3.common.synchronization [req-29107b17-8a71-4c92-8cbf-f80081df31e5 req-b7762f7c-bd50-4e47-b9ed-34dc20bcdba1 service nova] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 979.139437] env[65511]: INFO networking_nsxv3.common.synchronization [req-29107b17-8a71-4c92-8cbf-f80081df31e5 req-b7762f7c-bd50-4e47-b9ed-34dc20bcdba1 service nova] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 979.143022] env[65511]: INFO networking_nsxv3.common.synchronization [req-29107b17-8a71-4c92-8cbf-f80081df31e5 req-b7762f7c-bd50-4e47-b9ed-34dc20bcdba1 service nova] Enqueued Resource ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b with Priority: HIGHEST for action port [ 979.143022] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 979.143022] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 979.143022] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b with Priority: HIGHEST for action port [ 979.143022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.143022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.143022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.143022] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.143022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.143633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.144240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.145427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.145632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.145750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.146021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.146217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.146640] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.147517] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-84305d27-a359-4cf2-bb40-3aa05cd9277b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.147676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.147746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.147952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.148084] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84305d27-a359-4cf2-bb40-3aa05cd9277b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.151193] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 979.151460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.322563] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d2f242b-f07c-4860-9f69-67ee36089fce: rpc.has_security_group_logging(os_id): False [ 979.341311] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.341518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.341518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.341795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.341893] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.342152] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.342243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.342302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.342453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.342527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.342612] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce is going to be created. [ 979.409071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.412182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.412275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.412477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.412673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.429020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: IN_PROGRESS for 2s [ 979.653688] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.653876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.655162] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.655162] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84305d27-a359-4cf2-bb40-3aa05cd9277b with status ACTIVE [ 979.655275] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.655338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.655419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.655637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.655734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.655934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.656051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.656102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.656266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.656341] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.656788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.658132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.658132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.658132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.658132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.658132] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b is going to be updated. [ 979.682473] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.682620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.682733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.682884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.683170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.683343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.160810] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.657115] env[65511]: INFO networking_nsxv3.common.synchronization [None req-21389d8d-977a-4e0a-8e79-e2c6f4bd87dc None None] Enqueued Resource ID: 5444ec23-5f55-4e71-aac2-9c9cea6835e7 with Priority: HIGHEST for action port [ 980.657206] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5444ec23-5f55-4e71-aac2-9c9cea6835e7 with Priority: HIGHEST for action port [ 980.660379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5444ec23-5f55-4e71-aac2-9c9cea6835e7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.660518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5444ec23-5f55-4e71-aac2-9c9cea6835e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.660587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5444ec23-5f55-4e71-aac2-9c9cea6835e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.660844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5444ec23-5f55-4e71-aac2-9c9cea6835e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.660931] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5444ec23-5f55-4e71-aac2-9c9cea6835e7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.666821] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.666821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.666821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.666821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.666821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.666821] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be created. [ 980.690950] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.690950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.690950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.690950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.690950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.699893] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: UNINITIALIZED for 2s [ 981.162464] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5444ec23-5f55-4e71-aac2-9c9cea6835e7 [ 981.162875] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.162943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.163086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.163319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.163420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.163562] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5444ec23-5f55-4e71-aac2-9c9cea6835e7 already deleted. [ 981.163686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5444ec23-5f55-4e71-aac2-9c9cea6835e7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.443361] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: SUCCESS [ 981.443361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.657570] env[65511]: INFO networking_nsxv3.common.synchronization [req-f869773e-8961-4b2c-9297-cf63f354c871 req-cfb8c63e-b4f3-4258-a7b2-2f94edffc03f tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 982.657570] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 982.657570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.657570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.658236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.658797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.660232] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.660466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.660679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.661061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.661328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.661609] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.714508] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: SUCCESS [ 982.714508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.714508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.714508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.714508] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.714891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.714891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.714891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.715044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.715044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.715170] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.166604] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.166754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.166940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.167323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.167501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.167825] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.167990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.168082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.168335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.168521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.168642] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 983.205740] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.205993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.206079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.206318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.206472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.217193] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.219333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 983.667844] env[65511]: INFO networking_nsxv3.common.synchronization [None req-2bf71ec7-2096-4a47-ac79-0f7788508e11 None None] Enqueued Resource ID: ec9f4975-9aa1-4e99-b126-36f120fa340d with Priority: HIGHEST for action port [ 983.669540] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec9f4975-9aa1-4e99-b126-36f120fa340d with Priority: HIGHEST for action port [ 983.669540] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec9f4975-9aa1-4e99-b126-36f120fa340d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.670054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec9f4975-9aa1-4e99-b126-36f120fa340d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.670054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec9f4975-9aa1-4e99-b126-36f120fa340d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.670054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec9f4975-9aa1-4e99-b126-36f120fa340d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.670162] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec9f4975-9aa1-4e99-b126-36f120fa340d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.721106] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22614963-faca-462c-8364-ac7ae98c2969: rpc.has_security_group_logging(os_id): False [ 983.921689] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.921689] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.921689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.921689] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be created. [ 983.969672] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.970105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.970175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.970363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.970796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.990878] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: IN_PROGRESS for 2s [ 984.178425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec9f4975-9aa1-4e99-b126-36f120fa340d [ 984.178425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.178425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.178425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.178425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.178425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.178425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec9f4975-9aa1-4e99-b126-36f120fa340d already deleted. [ 984.178839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec9f4975-9aa1-4e99-b126-36f120fa340d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.933180] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc986a43-3ee8-4a88-a520-8fb279ba31e3 req-3cbbbef6-ac72-4c4d-8346-0fb22423dcd2 tempest-ServerDiagnosticsTest-1427076355 tempest-ServerDiagnosticsTest-1427076355-project-member] Enqueued Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 984.933823] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGHEST for action security_group_members [ 984.934874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.935032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.935124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.935342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.935536] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.937840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.938033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.938297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.938465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.938583] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.233143] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 985.233143] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 985.233143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.430487] env[65511]: INFO networking_nsxv3.common.synchronization [req-8acbe5f5-56c0-4443-a941-09c07d0f3d0a req-69fe464e-62dd-446a-9a2e-e05a24c0cdaa tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 985.430803] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 985.431143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.431308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.431397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.431793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.431934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.432078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.432168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.432461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.432587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.432729] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.442339] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.442703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.442814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.443066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.443212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.443459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.443922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.444038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.445259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.445259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.445259] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a is going to be updated. [ 985.473173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.473334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.473405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.473621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.473772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.485493] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: IN_PROGRESS for 2s [ 985.809788] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.809975] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.810103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.810365] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.810612] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.810762] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.810872] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.811233] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.811437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.811690] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.811850] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.812008] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.812161] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.812342] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.812488] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.812660] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.838044] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.838044] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.838044] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.838044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.838044] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.838044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.838044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.838686] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.838686] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a87efd5d-0f78-4f4b-bea1-18104e31a9e6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.937906] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.937906] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.937906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.938503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.938503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.938503] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2505d7-9740-4169-97c7-e850756cca9e already deleted. [ 985.939198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.006823] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: SUCCESS [ 986.007419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.344031] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.344031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.344031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.344031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.344031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.344031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port a87efd5d-0f78-4f4b-bea1-18104e31a9e6 not found, creating... [ 986.344031] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.345473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.345473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.345473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.345701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.346076] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.346494] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.346494] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.347311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.347311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.347311] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: a87efd5d-0f78-4f4b-bea1-18104e31a9e6 is going to be created. [ 986.379637] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.380894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.380894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.380894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.380894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.380894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.142729] env[65511]: INFO networking_nsxv3.common.synchronization [req-8acbe5f5-56c0-4443-a941-09c07d0f3d0a req-8a149899-a4ea-481a-8fe7-d431d045961e service nova] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 987.143530] env[65511]: INFO networking_nsxv3.common.synchronization [req-8acbe5f5-56c0-4443-a941-09c07d0f3d0a req-8a149899-a4ea-481a-8fe7-d431d045961e service nova] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 987.143530] env[65511]: INFO networking_nsxv3.common.synchronization [req-8acbe5f5-56c0-4443-a941-09c07d0f3d0a req-8a149899-a4ea-481a-8fe7-d431d045961e service nova] Enqueued Resource ID: a87efd5d-0f78-4f4b-bea1-18104e31a9e6 with Priority: HIGHEST for action port [ 987.143675] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_rules [ 987.143726] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 987.143799] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87efd5d-0f78-4f4b-bea1-18104e31a9e6 with Priority: HIGHEST for action port [ 987.144107] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.144247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.144292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.144530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.144652] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.146114] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.146246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.146375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.146599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.146865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.146923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.146974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.147203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.147479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.147479] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.150007] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.150119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.150187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.150344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.150420] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a87efd5d-0f78-4f4b-bea1-18104e31a9e6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.497788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55791d1b-680e-4037-89f2-4b3bac998f5a in Status: SUCCESS [ 987.497788] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a deletion is rescheduled due to dependency. [ 987.497788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.651794] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.651922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.653817] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a87efd5d-0f78-4f4b-bea1-18104e31a9e6 with status ACTIVE [ 987.653817] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.653817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.654000] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.654060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.654147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.654324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.654415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.654473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.654632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.654774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.655075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.655185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.655245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.655394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.655468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.655558] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a87efd5d-0f78-4f4b-bea1-18104e31a9e6 is going to be updated. [ 987.658015] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.679057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.679209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.680346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.680346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.680346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.680346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a87efd5d-0f78-4f4b-bea1-18104e31a9e6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.162176] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.666157] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.666327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.666397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.666644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.666731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.668277] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2505d7-9740-4169-97c7-e850756cca9e is going to be created. [ 988.694877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.696243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.696340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.696630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.697316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.708661] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: UNINITIALIZED for 2s [ 989.059510] env[65511]: INFO networking_nsxv3.common.synchronization [req-85394a34-de0f-4457-bb2e-5befa398f791 req-20b4895c-6d2e-4a92-a7a6-4d0c15bd4150 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 989.059510] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 989.059510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.059510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.059510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.059840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.060484] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.060484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.060484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.060484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.060484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.060484] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.518489] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.518815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.519033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.519320] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.519658] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.519876] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.519934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.520222] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.520341] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.520569] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.520683] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.520794] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.520894] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.521025] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.521200] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.521310] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.544488] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.544598] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.544731] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.544914] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.545274] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-2b98014d-9d44-47e4-9a94-23ec560555e1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.545450] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.545566] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.545890] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.546043] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b98014d-9d44-47e4-9a94-23ec560555e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.563204] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.563204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.563428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.563466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.563638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.563768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.563862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.563923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.564077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.564158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.564265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 already deleted. [ 989.564396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.900225] env[65511]: INFO networking_nsxv3.common.synchronization [req-9fc317d9-f30a-4bda-9b9a-7619cc7d8fe1 req-70511ecc-295f-4fd0-a6a0-8c40d68aba8e tempest-ServersTestJSON-2089008876 tempest-ServersTestJSON-2089008876-project-member] Enqueued Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 989.900402] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 with Priority: HIGHEST for action security_group_members [ 989.901134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e9f87-12dd-4e82-864b-ae5b61fc4413 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.901277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.901372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.901610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.901805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.901937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.902066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.902200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.902327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.902438] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e9f87-12dd-4e82-864b-ae5b61fc4413',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.049668] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.049958] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.050111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.050567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.050721] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.050874] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 2b98014d-9d44-47e4-9a94-23ec560555e1 not found, creating... [ 990.051147] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.051301] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.051412] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.051638] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.051773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.052072] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.052226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.052338] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.052540] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.052671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.052827] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 2b98014d-9d44-47e4-9a94-23ec560555e1 is going to be created. [ 990.077305] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.077578] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.077742] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.078054] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.079776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.079776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.407324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.407324] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.407324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.407324] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 is going to be updated. [ 990.441499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.441661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.441759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.442034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.442196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.451497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: IN_PROGRESS for 2s [ 990.719529] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: SUCCESS [ 990.719813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.720046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.720420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.720633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.720833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.720905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.721118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.721204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721377] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.809575] env[65511]: INFO networking_nsxv3.common.synchronization [req-85394a34-de0f-4457-bb2e-5befa398f791 req-12c4f0d0-e41f-43fe-a44d-45739c7de540 service nova] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 990.809575] env[65511]: INFO networking_nsxv3.common.synchronization [req-85394a34-de0f-4457-bb2e-5befa398f791 req-12c4f0d0-e41f-43fe-a44d-45739c7de540 service nova] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 990.809575] env[65511]: INFO networking_nsxv3.common.synchronization [req-85394a34-de0f-4457-bb2e-5befa398f791 req-12c4f0d0-e41f-43fe-a44d-45739c7de540 service nova] Enqueued Resource ID: 2b98014d-9d44-47e4-9a94-23ec560555e1 with Priority: HIGHEST for action port [ 990.809831] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 990.812354] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 990.812354] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b98014d-9d44-47e4-9a94-23ec560555e1 with Priority: HIGHEST for action port [ 990.812354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.812354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.812354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.812354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.812354] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.814015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.814015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.814015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.814015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.814015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.814015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.814015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.814497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.814497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.814497] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.818394] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b98014d-9d44-47e4-9a94-23ec560555e1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.818394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.818394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.818394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.818394] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b98014d-9d44-47e4-9a94-23ec560555e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.981653] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1ad94eed-3089-4a99-a194-e8fc673a024f tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 990.982727] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 990.983228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.983474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.983474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.983910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.984155] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.106361] env[65511]: INFO networking_nsxv3.common.synchronization [None req-87573c8b-f52d-4843-93eb-8554b39b6ff7 tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 991.108988] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 991.109250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.109371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.227132] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.319832] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.319962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.320170] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.321836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b98014d-9d44-47e4-9a94-23ec560555e1 with status ACTIVE [ 991.321836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.321836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.321836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.321836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.321836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.322230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.322230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.322230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.322230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.322356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.322594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.322594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.322723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.322754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.322861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.322902] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b98014d-9d44-47e4-9a94-23ec560555e1 is going to be updated. [ 991.349584] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.349584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.349584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.349584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.349584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.349584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b98014d-9d44-47e4-9a94-23ec560555e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.512757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.512757] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5850f55-9492-4366-816e-5251bfefc2bb already deleted. [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.512757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.512757] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.555235] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e4f9aed-46ea-4431-9ff5-ec51103ab871 req-d2ea2769-6cbb-4aee-b134-653c618450db tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 991.555235] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 991.556208] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.556486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.556683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.557095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.557423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.557689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.558257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.558576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.558784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.559697] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.730953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad2505d7-9740-4169-97c7-e850756cca9e: rpc.has_security_group_logging(os_id): False [ 991.753049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.753049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.753049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.753697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.753697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.753782] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.753902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.753902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.754052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.758165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.758165] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad2505d7-9740-4169-97c7-e850756cca9e is going to be created. [ 991.825559] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.828811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.828811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.828811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.828955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.829505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.841427] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: IN_PROGRESS for 2s [ 991.965674] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.965929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.965991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.966229] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.966479] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.966711] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.966845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.967336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.967336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.967452] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.967685] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.967685] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.967803] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.967803] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.967896] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.968024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.993211] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.993211] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.993211] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.993211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.993211] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-db20aa83-1893-432a-b835-a3276ca2cd62 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.993211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.993211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.993854] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.994261] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db20aa83-1893-432a-b835-a3276ca2cd62',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.039745] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.039745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.039745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.040045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.040045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.040597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5850f55-9492-4366-816e-5251bfefc2bb already deleted. [ 992.040597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.062577] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.327622] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.327854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.327854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.328286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.328404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.328485] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be created. [ 992.356714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.357123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.357546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.372327] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: UNINITIALIZED for 2s [ 992.464419] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 in Status: SUCCESS [ 992.464419] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e9f87-12dd-4e82-864b-ae5b61fc4413 deletion is rescheduled due to dependency. [ 992.464563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e9f87-12dd-4e82-864b-ae5b61fc4413" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.497359] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.497492] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.497539] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.498224] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.498224] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.498224] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port db20aa83-1893-432a-b835-a3276ca2cd62 not found, creating... [ 992.498444] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.498637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.498766] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.499016] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.499155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.499444] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.500226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.500226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.500226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.500226] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.500409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: db20aa83-1893-432a-b835-a3276ca2cd62 is going to be created. [ 992.521083] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.521083] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.521083] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.521540] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.521726] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.521890] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.565642] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.067220] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.067703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.067703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.067703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.067896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.067953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 993.107739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.108486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.108486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.108486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.108699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.123333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 993.322258] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e4f9aed-46ea-4431-9ff5-ec51103ab871 req-24b69a1a-3eaf-49b0-ba8a-e0a21e7f9945 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 993.322432] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e4f9aed-46ea-4431-9ff5-ec51103ab871 req-24b69a1a-3eaf-49b0-ba8a-e0a21e7f9945 service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 993.322686] env[65511]: INFO networking_nsxv3.common.synchronization [req-8e4f9aed-46ea-4431-9ff5-ec51103ab871 req-24b69a1a-3eaf-49b0-ba8a-e0a21e7f9945 service nova] Enqueued Resource ID: db20aa83-1893-432a-b835-a3276ca2cd62 with Priority: HIGHEST for action port [ 993.323717] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 993.323875] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 993.324157] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db20aa83-1893-432a-b835-a3276ca2cd62 with Priority: HIGHEST for action port [ 993.324708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.324865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.324940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.325207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.325280] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.326234] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.326354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.326633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-db20aa83-1893-432a-b835-a3276ca2cd62 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.326759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.326759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.327327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.327327] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db20aa83-1893-432a-b835-a3276ca2cd62',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.829850] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.829968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.830141] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db20aa83-1893-432a-b835-a3276ca2cd62 with status ACTIVE [ 993.831506] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.831674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.831925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.831999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.832673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.832673] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.832673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.832673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.832673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.832673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.832941] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.832994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.833147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.833213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.833282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.833362] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db20aa83-1893-432a-b835-a3276ca2cd62 is going to be updated. [ 993.856249] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: SUCCESS [ 993.857166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.863250] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.863250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.863250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.863250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.863250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.863250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db20aa83-1893-432a-b835-a3276ca2cd62" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.213575] env[65511]: INFO networking_nsxv3.common.synchronization [req-cfdcaae8-536f-4768-93cd-75bd85239042 req-a650929f-c21d-4e76-a07e-f9726146a42e tempest-AttachInterfacesV270Test-1977197380 tempest-AttachInterfacesV270Test-1977197380-project-member] Enqueued Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 994.214083] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 994.214985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.214985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.214985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.215217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.216028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.216028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.216028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.216028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.216028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.216028] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.383091] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 994.383091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.383552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.383796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.384008] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.384131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.384194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.384794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.384794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.384794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.384794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.628162] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.628411] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-547" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.628535] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-547" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.628948] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-547" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.629257] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.629452] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.629588] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.629819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.629965] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.630222] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.630346] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.630451] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.630550] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.630685] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.630748] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.630918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.652905] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.653179] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.653351] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.653574] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-547" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.653930] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-57467662-2a07-4f28-ace0-ff883e108d70 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.654116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.655019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.655019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.655019] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57467662-2a07-4f28-ace0-ff883e108d70',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.718492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.718757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.718862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.719119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.719212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.719421] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.719522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.719611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.719772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.719861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.719994] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53044249-4154-4da6-ae48-a91634987f8e already deleted. [ 994.720155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.887369] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.134432] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 995.134602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.134919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.135746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.135746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.135746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.135746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.135934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.135934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.136072] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.158426] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.158426] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.158579] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.158801] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.159029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.159157] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 57467662-2a07-4f28-ace0-ff883e108d70 not found, creating... [ 995.159454] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.159609] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.159726] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.159980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.160129] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.160441] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.160601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.160713] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.160920] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.161070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.161207] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 57467662-2a07-4f28-ace0-ff883e108d70 is going to be created. [ 995.183347] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.183570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.183735] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.183984] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.184230] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.184456] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.393245] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83993e26-a536-4b93-ac9b-bdc8e2e16ee7: rpc.has_security_group_logging(os_id): False [ 995.426880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.427111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.427187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.427396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.427500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.427843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.427914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.427981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.428187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.428302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.428405] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be created. [ 995.508774] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.508774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.509031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.509942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.509942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.521238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 995.638289] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.975462] env[65511]: INFO networking_nsxv3.common.synchronization [req-cfdcaae8-536f-4768-93cd-75bd85239042 req-2b2f4746-41ea-4572-ace7-69d03d1e37b3 service nova] Enqueued Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_rules [ 995.976028] env[65511]: INFO networking_nsxv3.common.synchronization [req-cfdcaae8-536f-4768-93cd-75bd85239042 req-2b2f4746-41ea-4572-ace7-69d03d1e37b3 service nova] Enqueued Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 995.976028] env[65511]: INFO networking_nsxv3.common.synchronization [req-cfdcaae8-536f-4768-93cd-75bd85239042 req-2b2f4746-41ea-4572-ace7-69d03d1e37b3 service nova] Enqueued Resource ID: 57467662-2a07-4f28-ace0-ff883e108d70 with Priority: HIGHEST for action port [ 995.976288] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_rules [ 995.976423] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 995.976520] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57467662-2a07-4f28-ace0-ff883e108d70 with Priority: HIGHEST for action port [ 995.976969] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.977152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.977214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.977434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.977520] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.979016] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.979016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.979016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.979016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.979289] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.979289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.979402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.979460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.979545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.979633] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.980434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-57467662-2a07-4f28-ace0-ff883e108d70 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.980545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.980595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.980746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.980815] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57467662-2a07-4f28-ace0-ff883e108d70',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.143807] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.345031] env[65511]: INFO networking_nsxv3.common.synchronization [req-0d6f9b19-9113-41aa-b85d-0ecb0a55ce11 req-49859183-fb64-479d-8afd-0f0b0838697e tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 996.346461] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 996.349170] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.349455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.349455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.349615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.349827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.349916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.350072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.350131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.350317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.350369] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.484419] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.484973] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.485180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.485746] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57467662-2a07-4f28-ace0-ff883e108d70 with status ACTIVE [ 996.486051] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.486184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.486353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.487038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.487038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.487038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.487335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.487335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.487533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.487681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.487976] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.488145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.488239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.488463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.488581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.488724] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57467662-2a07-4f28-ace0-ff883e108d70 is going to be updated. [ 996.531596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.531890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.531890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.532078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.532242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.532328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57467662-2a07-4f28-ace0-ff883e108d70" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.647657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.647959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.648098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.648236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.648347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.648511] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 996.683357] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.683357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.683357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.683357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.683357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.693937] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 996.853993] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.854207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.854279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.854623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.854623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.854880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.855034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.855034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.855265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.855366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.855366] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 996.884987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.885270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.885416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.885908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.886037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.899613] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 996.986204] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.488506] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.488965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.488965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.489091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.489200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.489327] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53044249-4154-4da6-ae48-a91634987f8e is going to be created. [ 997.515878] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.515878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.516188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.516188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.516318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.529887] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: UNINITIALIZED for 2s [ 997.537939] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 997.538148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.706626] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 998.706626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.706626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.706626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.706626] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.706626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.707209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.707209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.707209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.707209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.707209] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.915296] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 998.915575] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 998.915737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.209402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.209554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.209737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.209851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.213798] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.214043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.214119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.214333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.214408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.214509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.214710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.214832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.214886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.215055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.216087] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.216087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.216087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.216087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.216087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.216087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.216087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.545345] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: SUCCESS [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.547894] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.547894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.547894] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.719053] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 999.737480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.737764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.737764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.738014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.738146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.738372] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.738463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.738530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.738691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.738773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.739026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.739174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.739247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.739418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.739495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.739921] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.740032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.740098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.740295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.740337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.740400] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 999.826898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.827089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.827218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.827388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.827602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.858617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1000.051687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.051966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.052049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.052389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.052612] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.052744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.052796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.052999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.053247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.053363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.053583] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.053722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.053799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.054012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.054191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.054319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.054393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.054565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.054649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.054740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.054887] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.557015] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53044249-4154-4da6-ae48-a91634987f8e: rpc.has_security_group_logging(os_id): False [ 1000.576283] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.576573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.576573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.576737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.576854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.578172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.578172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.578172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.578576] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.578576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.578576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.578576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.578576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.578765] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53044249-4154-4da6-ae48-a91634987f8e is going to be created. [ 1000.653281] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.653526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.653648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.654091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.654346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.668304] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: IN_PROGRESS for 2s [ 1001.346762] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1001.346951] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1001.878581] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1001.878581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.683288] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: SUCCESS [ 1002.683725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.048546] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-e8ef619f-55da-48f1-b1e6-80ad533833e2 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1003.049788] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1003.050692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.050692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.050692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.050692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.051031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.051031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.051031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.051031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.051252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.051252] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.557223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.557223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.557223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.557223] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1003.583507] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.583695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.583776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.584048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.584289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.595785] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1004.065657] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-d1a47e93-13b0-471e-8235-070e8a38afc6 tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1004.068020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1004.068872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.068982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.514803] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.514803] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-229" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.514978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-229" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.515439] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-229" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.515824] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.517192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.517192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.517192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.517192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.517418] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.517551] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.517708] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.517860] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.517933] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.518053] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.518263] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.538065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.538708] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.538708] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.538708] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-229" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.539670] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-661c1237-9c70-4a57-b17a-5b739313f6f4 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.539670] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.539782] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.540155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.540317] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661c1237-9c70-4a57-b17a-5b739313f6f4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.024202] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f349048e-789f-460d-bea5-5daaef008236 None None] Enqueued Resource ID: e7dd8a94-ceff-4569-af3e-24615a1d7558 with Priority: HIGHEST for action port [ 1005.024202] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7dd8a94-ceff-4569-af3e-24615a1d7558 with Priority: HIGHEST for action port [ 1005.025107] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7dd8a94-ceff-4569-af3e-24615a1d7558 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.025578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7dd8a94-ceff-4569-af3e-24615a1d7558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.026664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7dd8a94-ceff-4569-af3e-24615a1d7558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.027604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7dd8a94-ceff-4569-af3e-24615a1d7558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.027604] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7dd8a94-ceff-4569-af3e-24615a1d7558',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.046036] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.046036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 661c1237-9c70-4a57-b17a-5b739313f6f4 not found, creating... [ 1005.046036] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.046611] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.047481] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.047788] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.049477] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 661c1237-9c70-4a57-b17a-5b739313f6f4 is going to be created. [ 1005.070463] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.072640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.072640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.072640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.072640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.072640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.531299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7dd8a94-ceff-4569-af3e-24615a1d7558 [ 1005.531299] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.531299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.531299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.531299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.531299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.531299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7dd8a94-ceff-4569-af3e-24615a1d7558 already deleted. [ 1005.531299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7dd8a94-ceff-4569-af3e-24615a1d7558" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.606921] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1005.609018] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 deletion is rescheduled due to dependency. [ 1005.609018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.609018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.609284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.609903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.609903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.609903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.610052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.610161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.610623] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.867964] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-12a4d6d5-4f60-4e5c-a9d5-c694ae4257e3 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 1005.868153] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-12a4d6d5-4f60-4e5c-a9d5-c694ae4257e3 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1005.868287] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-12a4d6d5-4f60-4e5c-a9d5-c694ae4257e3 service nova] Enqueued Resource ID: 661c1237-9c70-4a57-b17a-5b739313f6f4 with Priority: HIGHEST for action port [ 1005.868834] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 1005.871160] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1005.872028] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661c1237-9c70-4a57-b17a-5b739313f6f4 with Priority: HIGHEST for action port [ 1005.872028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.872028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.872028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.872028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.872268] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.873258] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.873338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.874614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-661c1237-9c70-4a57-b17a-5b739313f6f4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.874614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.874614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.874614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.874614] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661c1237-9c70-4a57-b17a-5b739313f6f4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.114791] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.195106] env[65511]: INFO networking_nsxv3.common.synchronization [req-b806ee8d-f6e6-45d5-ab5e-f0ca6283de8d req-e2bae2f2-d835-4ee6-82af-0d58c67d485d tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1006.195724] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1006.196091] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.196219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.197345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.198345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.198345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.198345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.198345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.198559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.198559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.198673] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.378598] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.378598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.379811] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 661c1237-9c70-4a57-b17a-5b739313f6f4 with status ACTIVE [ 1006.380019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.380297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.380297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.380414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.380503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.380687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.380799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.380835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.380989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.381075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.381402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.381501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.381621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.381702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.381776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.381861] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 661c1237-9c70-4a57-b17a-5b739313f6f4 is going to be updated. [ 1006.427323] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.427323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.427552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.427588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.429568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.429568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-661c1237-9c70-4a57-b17a-5b739313f6f4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.606063] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.606063] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.606063] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.606641] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.607125] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.607318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.607437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.607707] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.607935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.608224] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.608285] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.608375] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.608481] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.608588] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.608691] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.608837] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.621146] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.629470] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.630120] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.630407] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.630804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.631353] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.632376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.632376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.632376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.636206] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2078bb64-02ef-495a-b8e4-ec6d1f80c5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.695042] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.695042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-400" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.695321] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-400" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.695480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-400" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.695744] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.695896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.696014] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.696236] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.696496] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.696777] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.696903] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.697017] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.697125] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.697232] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.697332] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.697461] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.701534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.701682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.701717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.701912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.702065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.702212] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.702306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.702365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.702524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.702598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.702687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1006.717617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.717825] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.717946] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.718167] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-400" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.718490] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-5c293a58-6d68-4b7e-82e2-91a069bb88aa taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.718659] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.718774] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.719121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.719257] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c293a58-6d68-4b7e-82e2-91a069bb88aa',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.733280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.733430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.734036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.734036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.734036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.745338] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1007.123573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.123951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.123951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.124042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.124121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.124226] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1007.139522] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.139738] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.139857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.140165] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.140311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.140458] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 not found, creating... [ 1007.140711] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.140863] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.141057] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.141281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.141415] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.141693] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.141844] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.141956] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.142171] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.142301] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.142435] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 is going to be created. [ 1007.156047] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.156236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.156282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.156909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.157242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.165109] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.165336] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.165458] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.165747] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.165971] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.166209] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.167550] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1007.222182] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.222182] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.222182] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.222433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.222471] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.222604] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 5c293a58-6d68-4b7e-82e2-91a069bb88aa not found, creating... [ 1007.222852] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.223010] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.223134] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.223345] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.223473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.223899] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.224276] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.224519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.228018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.228018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.228018] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 5c293a58-6d68-4b7e-82e2-91a069bb88aa is going to be created. [ 1007.253649] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.253649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.253649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.253649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.253935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.254274] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.867907] env[65511]: INFO networking_nsxv3.common.synchronization [req-b806ee8d-f6e6-45d5-ab5e-f0ca6283de8d req-32836d06-6d21-4095-b480-c9a42a8303a2 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1007.868096] env[65511]: INFO networking_nsxv3.common.synchronization [req-b806ee8d-f6e6-45d5-ab5e-f0ca6283de8d req-32836d06-6d21-4095-b480-c9a42a8303a2 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1007.868231] env[65511]: INFO networking_nsxv3.common.synchronization [req-b806ee8d-f6e6-45d5-ab5e-f0ca6283de8d req-32836d06-6d21-4095-b480-c9a42a8303a2 service nova] Enqueued Resource ID: 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 with Priority: HIGHEST for action port [ 1007.869380] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1007.869380] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1007.869380] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 with Priority: HIGHEST for action port [ 1007.871095] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.871222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.871285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.871498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.871571] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.872530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.872628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.872858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.872967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.873055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.873232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.873590] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2078bb64-02ef-495a-b8e4-ec6d1f80c5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.931456] env[65511]: INFO networking_nsxv3.common.synchronization [None req-1c3f950b-76cc-4b81-b67b-c5de38074654 None None] Enqueued Resource ID: 52f107fa-f75d-4fc3-ace7-81e18b3e795d with Priority: HIGHEST for action port [ 1007.931923] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f107fa-f75d-4fc3-ace7-81e18b3e795d with Priority: HIGHEST for action port [ 1007.932393] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f107fa-f75d-4fc3-ace7-81e18b3e795d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.932539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f107fa-f75d-4fc3-ace7-81e18b3e795d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.932680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f107fa-f75d-4fc3-ace7-81e18b3e795d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.933074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f107fa-f75d-4fc3-ace7-81e18b3e795d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.933233] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f107fa-f75d-4fc3-ace7-81e18b3e795d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.971808] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-a6277e81-2e94-4419-bfe9-dc70ae422962 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 1007.972202] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-a6277e81-2e94-4419-bfe9-dc70ae422962 service nova] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1007.972202] env[65511]: INFO networking_nsxv3.common.synchronization [req-29539578-8139-4505-aa85-df2fb55d30ec req-a6277e81-2e94-4419-bfe9-dc70ae422962 service nova] Enqueued Resource ID: 5c293a58-6d68-4b7e-82e2-91a069bb88aa with Priority: HIGHEST for action port [ 1007.972437] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_rules [ 1007.972551] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1007.972643] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c293a58-6d68-4b7e-82e2-91a069bb88aa with Priority: HIGHEST for action port [ 1007.973185] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.973266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.973458] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.973537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.973712] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c293a58-6d68-4b7e-82e2-91a069bb88aa taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.973822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.973874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.974232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.974336] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c293a58-6d68-4b7e-82e2-91a069bb88aa',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.376539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.376978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.377043] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 with status ACTIVE [ 1008.377257] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.377373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.377437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.377653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.378061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.378254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.378357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.378441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.378658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.378774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.378965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.379090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.379154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.380262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.380262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.380262] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2078bb64-02ef-495a-b8e4-ec6d1f80c5a6 is going to be updated. [ 1008.424171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.424321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.424395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.424645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.424768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.424949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2078bb64-02ef-495a-b8e4-ec6d1f80c5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.435726] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52f107fa-f75d-4fc3-ace7-81e18b3e795d [ 1008.436276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.436276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.436463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.436573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.436751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.436883] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52f107fa-f75d-4fc3-ace7-81e18b3e795d already deleted. [ 1008.436998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f107fa-f75d-4fc3-ace7-81e18b3e795d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.478790] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c293a58-6d68-4b7e-82e2-91a069bb88aa with status ACTIVE [ 1008.478952] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.479219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.479293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.479516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.479608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.479804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.479905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.479958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.480127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.480204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.480391] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.480486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.480547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.480689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.480764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.480851] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c293a58-6d68-4b7e-82e2-91a069bb88aa is going to be updated. [ 1008.509627] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.509835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.509835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.510072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.510218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.510388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c293a58-6d68-4b7e-82e2-91a069bb88aa" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.758081] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1008.758299] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 deletion is rescheduled due to dependency. [ 1008.758408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.758567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.758787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.758978] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.759108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.759165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.759322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.759403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.759497] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.177827] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1009.178059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.178246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.178538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.178733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.178873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.178922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.179076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.179150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.179243] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.264394] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.682389] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.766461] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.184646] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.270392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.270556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.270637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.270899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.271012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.271130] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1010.303134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.303312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.303399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.303641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.304104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.315451] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1010.689178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.689178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.689178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.689178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.689178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.689178] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1010.717452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.717624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.717721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.717996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.718166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.728828] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1012.328691] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1012.329037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.329181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.329442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.329634] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.329745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.329806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.329994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.330619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.330619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.330732] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.741031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1012.741200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.741380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.741605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.741807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.741925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.741989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.742242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.742347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.743028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.743028] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.743838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.743838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.743838] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.744026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.744026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.744103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.744151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.744212] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.834428] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.974078] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1012.974868] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1013.246495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.246674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.250056] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.337821] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 1013.363600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.363600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.363600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.363600] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1013.451396] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.451534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.451605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.451813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.451955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.472926] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1013.481141] env[65511]: INFO networking_nsxv3.common.synchronization [req-3c7dcae9-48a7-4d3b-984f-83e8a85b4085 req-ee6a3f2a-cab8-436e-a134-562f4cdcdc13 tempest-AttachInterfacesV270Test-1977197380 tempest-AttachInterfacesV270Test-1977197380-project-member] Enqueued Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 1013.481984] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53044249-4154-4da6-ae48-a91634987f8e with Priority: HIGHEST for action security_group_members [ 1013.481984] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-53044249-4154-4da6-ae48-a91634987f8e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.483749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.483749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.483749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.483749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.484233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.484233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.484233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.484233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.484233] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53044249-4154-4da6-ae48-a91634987f8e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.565219] env[65511]: INFO networking_nsxv3.common.synchronization [req-fd0e5dd6-8d07-49d1-b805-c8beabf7b95e req-b18ed1e7-c43a-41d3-8e80-bbf58a5116d9 tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1013.567551] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1013.567551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.567551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.567551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.568538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.571066] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.571066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.571066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.571066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.571066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.571066] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.753656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.945789] env[65511]: INFO networking_nsxv3.common.synchronization [None req-73a3a220-fdad-4275-b6cd-3d38a11ff7ba None None] Enqueued Resource ID: 6bc72e9c-0c39-42d2-8df3-8106b1747285 with Priority: HIGHEST for action port [ 1013.946314] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bc72e9c-0c39-42d2-8df3-8106b1747285 with Priority: HIGHEST for action port [ 1013.946620] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bc72e9c-0c39-42d2-8df3-8106b1747285 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.946765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bc72e9c-0c39-42d2-8df3-8106b1747285" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.946830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bc72e9c-0c39-42d2-8df3-8106b1747285" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.947110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bc72e9c-0c39-42d2-8df3-8106b1747285" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.947193] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bc72e9c-0c39-42d2-8df3-8106b1747285',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.988620] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.988850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.988952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.989271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.989391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.989649] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.989760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.989824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.990046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.990138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.990283] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53044249-4154-4da6-ae48-a91634987f8e is going to be updated. [ 1014.033765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.033958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.033958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.034264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.034415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.045972] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: IN_PROGRESS for 2s [ 1014.073322] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.257186] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.257462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.257462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.257657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.257754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.258118] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1014.310681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.310681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.310813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.310950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.311399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.325642] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1014.449513] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bc72e9c-0c39-42d2-8df3-8106b1747285 [ 1014.449870] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.450268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.450374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.450699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.450799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.450919] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bc72e9c-0c39-42d2-8df3-8106b1747285 already deleted. [ 1014.451039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bc72e9c-0c39-42d2-8df3-8106b1747285" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.575224] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.618498] env[65511]: INFO networking_nsxv3.common.synchronization [req-c4fa5516-ecf0-4cf4-8014-47f65ff3370e req-a222b12b-2a11-4ae8-8534-2499167f7dab tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1014.620521] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1014.622616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.622737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.622829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.623151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.623326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.623429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.623491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.623652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.623737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.623852] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.032293] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.032503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.032629] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.032983] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.033289] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.033431] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.033671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.033835] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.034021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.034258] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.034367] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.034472] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.034573] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.034677] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.034800] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.034942] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.056448] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.056568] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.057086] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.057086] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-679" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.057399] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.057592] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.057731] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.058063] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.058204] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.078918] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.079175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.079422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.079693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.079811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.080024] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 1015.108248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.108436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.108501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.109032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.109032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.120503] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1015.126095] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.126095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.126095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.126323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.126381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.126570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.127423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.127423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.127423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.127423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.127423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5850f55-9492-4366-816e-5251bfefc2bb already deleted. [ 1015.127423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.495251] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1015.495251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.560598] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.562244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.562244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.562244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.562244] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.562244] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 not found, creating... [ 1015.562244] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.562518] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.562518] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.562665] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.562797] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.563091] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.563246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.563355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.563555] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.563692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.563827] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 is going to be created. [ 1015.587185] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.587185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.587185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.587185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.587185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.587557] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.882485] env[65511]: INFO networking_nsxv3.common.synchronization [None req-82ed91f1-6e05-4b9e-8670-560fb42c9073 None None] Enqueued Resource ID: dfa5f00d-4bb4-4fb9-8e50-aac4678e957e with Priority: HIGHEST for action port [ 1015.883942] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfa5f00d-4bb4-4fb9-8e50-aac4678e957e with Priority: HIGHEST for action port [ 1015.883942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfa5f00d-4bb4-4fb9-8e50-aac4678e957e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.884200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfa5f00d-4bb4-4fb9-8e50-aac4678e957e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.884200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfa5f00d-4bb4-4fb9-8e50-aac4678e957e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.885305] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfa5f00d-4bb4-4fb9-8e50-aac4678e957e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.885305] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa5f00d-4bb4-4fb9-8e50-aac4678e957e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.047368] env[65511]: INFO networking_nsxv3.common.synchronization [req-0766c03d-c643-4808-8f31-61e0056b219d req-fadc4f7f-5365-41eb-8573-566d34dc73b1 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1016.052205] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1016.053836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.054813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.054989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.055316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.055580] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.055748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.055929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.056161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.056311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.056369] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.066991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53044249-4154-4da6-ae48-a91634987f8e in Status: SUCCESS [ 1016.067262] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53044249-4154-4da6-ae48-a91634987f8e deletion is rescheduled due to dependency. [ 1016.067427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53044249-4154-4da6-ae48-a91634987f8e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.278319] env[65511]: INFO networking_nsxv3.common.synchronization [None req-5cdbd94d-388f-444a-b4b7-a48ace0197b0 None None] Enqueued Resource ID: d4422954-f7ae-4c44-a37f-344523d55ed7 with Priority: HIGHEST for action port [ 1016.279478] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4422954-f7ae-4c44-a37f-344523d55ed7 with Priority: HIGHEST for action port [ 1016.279842] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4422954-f7ae-4c44-a37f-344523d55ed7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.279961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4422954-f7ae-4c44-a37f-344523d55ed7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.280039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4422954-f7ae-4c44-a37f-344523d55ed7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.280308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4422954-f7ae-4c44-a37f-344523d55ed7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.280386] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4422954-f7ae-4c44-a37f-344523d55ed7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.337811] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1016.338181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.338550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.338863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.339725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.339905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.339975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.340120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.340205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.340295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.340461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.340555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.340617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.340761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.340903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.340993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.342086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.344951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.345378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.345378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.345378] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.373128] env[65511]: INFO networking_nsxv3.common.synchronization [req-c4fa5516-ecf0-4cf4-8014-47f65ff3370e req-8f185dbf-8fcf-44db-bd7a-7e6d695d8739 service nova] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 1016.373464] env[65511]: INFO networking_nsxv3.common.synchronization [req-c4fa5516-ecf0-4cf4-8014-47f65ff3370e req-8f185dbf-8fcf-44db-bd7a-7e6d695d8739 service nova] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1016.373554] env[65511]: INFO networking_nsxv3.common.synchronization [req-c4fa5516-ecf0-4cf4-8014-47f65ff3370e req-8f185dbf-8fcf-44db-bd7a-7e6d695d8739 service nova] Enqueued Resource ID: f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 with Priority: HIGHEST for action port [ 1016.375412] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_rules [ 1016.376120] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1016.376120] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 with Priority: HIGHEST for action port [ 1016.376204] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.376427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.376520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.376959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.377192] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.378425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.378635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.378754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.379402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.379603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.379889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.379889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.380050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.380251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.381448] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.381608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.381608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.381717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.382346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.382346] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.390382] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfa5f00d-4bb4-4fb9-8e50-aac4678e957e [ 1016.390692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.390802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.390839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.391059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.391137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.391496] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfa5f00d-4bb4-4fb9-8e50-aac4678e957e already deleted. [ 1016.391496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfa5f00d-4bb4-4fb9-8e50-aac4678e957e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.559928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.560600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.563166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.563166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.563166] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1016.595458] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.595728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.595728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.595975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.596148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.606947] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1016.645261] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.645610] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.645789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.646189] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.646598] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.646897] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.647097] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.647503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.647701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.648060] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.648250] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.648430] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.648603] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.648813] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.648997] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.649667] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.673975] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.673975] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.673975] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.673975] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.673975] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.675227] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.675611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.676461] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.676913] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ba5e5bf-c222-48cb-aeaa-fbe48695468b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.784871] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4422954-f7ae-4c44-a37f-344523d55ed7 [ 1016.787102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.787102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.787102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.787102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.787102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.787102] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4422954-f7ae-4c44-a37f-344523d55ed7 already deleted. [ 1016.787102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4422954-f7ae-4c44-a37f-344523d55ed7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.847796] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a82020c-f023-4af6-a870-9b8623205ed1: rpc.has_security_group_logging(os_id): False [ 1016.872364] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.872578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.872578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.872940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.873155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.873319] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.873428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.873483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.873675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.873757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.873965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.874086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.874170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.874295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.874366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.874524] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.874607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.874764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.874837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.874938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.874938] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1016.884407] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.886316] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.886405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.886707] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 with status ACTIVE [ 1016.886871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.888064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.888239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.889090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.889090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.889302] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.889467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.889573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.891647] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.891647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.891647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1 is going to be updated. [ 1016.920739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.921014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.923215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.923370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.924660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.924660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f01bd50e-05bc-49c7-aaee-bc9fcdd38cd1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.985984] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.986271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.986557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.986741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.987048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.006071] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1017.132421] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1017.132733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.180471] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.180725] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.180840] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.181237] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.181367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.181524] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 9ba5e5bf-c222-48cb-aeaa-fbe48695468b not found, creating... [ 1017.181796] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.181950] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.182071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.182300] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.182433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.183632] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.183815] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.184656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.184656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.184656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.184656] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 9ba5e5bf-c222-48cb-aeaa-fbe48695468b is going to be created. [ 1017.209382] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.209631] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.209792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.210137] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.210378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.210795] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.395764] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.899570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.900043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.900043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.900126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.900170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.900277] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5850f55-9492-4366-816e-5251bfefc2bb is going to be created. [ 1017.925915] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.926045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.926126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.926306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.926473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.937898] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: UNINITIALIZED for 2s [ 1018.036277] env[65511]: INFO networking_nsxv3.common.synchronization [req-0766c03d-c643-4808-8f31-61e0056b219d req-eec3ed99-8d3c-442c-92ae-de5a2f28eac4 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1018.036277] env[65511]: INFO networking_nsxv3.common.synchronization [req-0766c03d-c643-4808-8f31-61e0056b219d req-eec3ed99-8d3c-442c-92ae-de5a2f28eac4 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1018.036277] env[65511]: INFO networking_nsxv3.common.synchronization [req-0766c03d-c643-4808-8f31-61e0056b219d req-eec3ed99-8d3c-442c-92ae-de5a2f28eac4 service nova] Enqueued Resource ID: 9ba5e5bf-c222-48cb-aeaa-fbe48695468b with Priority: HIGHEST for action port [ 1018.036906] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1018.036906] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1018.037226] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba5e5bf-c222-48cb-aeaa-fbe48695468b with Priority: HIGHEST for action port [ 1018.037292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.037632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.037632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.037719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.037749] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.039799] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.039799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.040435] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.040435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.040435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.040435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.040435] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ba5e5bf-c222-48cb-aeaa-fbe48695468b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.540597] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.540762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.542809] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ba5e5bf-c222-48cb-aeaa-fbe48695468b with status ACTIVE [ 1018.542809] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.542809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.542809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.542809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.543110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.543146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.544535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.544535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.544535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.544535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.544854] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.544854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.544854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.544854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.548202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.548202] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ba5e5bf-c222-48cb-aeaa-fbe48695468b is going to be updated. [ 1018.567542] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.567749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.567875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.568086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.568683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.568935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ba5e5bf-c222-48cb-aeaa-fbe48695468b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.617405] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1018.617655] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1018.617736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.617943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.619052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.619052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.619052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.619052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.619052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.619052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.619052] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.025551] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1019.026970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.026970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.026970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.026970] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.121776] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.529534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.529691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.529763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.529984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.530165] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.530264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.530326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.530483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.530566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.530652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.530738] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.625402] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.947877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: SUCCESS [ 1019.948131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.948293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.948512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.948706] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.948824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.948889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.949067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.949139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.949221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.949310] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.983481] env[65511]: INFO networking_nsxv3.common.synchronization [None req-671d3c95-1a2f-4219-98ec-551caf00e655 None None] Enqueued Resource ID: 761b87df-9c7b-44ae-9a65-3bb634ae326e with Priority: HIGHEST for action port [ 1019.984084] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761b87df-9c7b-44ae-9a65-3bb634ae326e with Priority: HIGHEST for action port [ 1019.984456] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-761b87df-9c7b-44ae-9a65-3bb634ae326e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.984585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761b87df-9c7b-44ae-9a65-3bb634ae326e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.984682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761b87df-9c7b-44ae-9a65-3bb634ae326e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.984956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761b87df-9c7b-44ae-9a65-3bb634ae326e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.985046] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761b87df-9c7b-44ae-9a65-3bb634ae326e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.032678] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.033064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.033064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.033193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.033382] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.033509] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.033575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.033757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.033858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.033965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.034210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.034340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.034407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.034631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.034858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.034971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.035037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.035204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.035293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.035392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.035482] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.128522] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.128771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.128846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.130040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.130040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.130040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1020.166628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.166840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.166908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.167365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.167365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.179306] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1020.452640] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.487176] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761b87df-9c7b-44ae-9a65-3bb634ae326e [ 1020.487410] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.487586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.487629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.488074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.488074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.488074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761b87df-9c7b-44ae-9a65-3bb634ae326e already deleted. [ 1020.488074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761b87df-9c7b-44ae-9a65-3bb634ae326e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.517221] env[65511]: INFO networking_nsxv3.common.synchronization [req-76ce656f-eb7f-431f-8337-3cc6eb61860f req-1c1f1f5c-2c6c-4364-a16e-a93c8a611794 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1020.517796] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1020.518126] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.518246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.518308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.518503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.518654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.519169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.519235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.519387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.519477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.519570] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.538308] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a82020c-f023-4af6-a870-9b8623205ed1: rpc.has_security_group_logging(os_id): False [ 1020.556461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.556614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.556653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.556913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.557014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.557226] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.557326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.557384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.557545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.557623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.557822] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.557916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.557973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.558184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.558217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.558393] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.558484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.558543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.559118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.559206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.559348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1020.619352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.619352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.619352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.619352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.619352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.634900] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1020.811020] env[65511]: INFO networking_nsxv3.common.synchronization [req-2ae8b0c4-1e29-4b48-9f0f-0b322e343c53 req-1a4663b9-8bf0-4fb3-9125-af250b0f0c9f tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1020.811020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1020.813036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.813036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.813036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.813036] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.837773] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.837773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.837773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.837773] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.838225] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.838412] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.838561] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.838811] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.839027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.839235] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.839343] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.839444] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.839543] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.839645] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.839741] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.839869] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.861402] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.861569] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.861699] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.861870] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.862193] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-99f13ce5-717c-44c7-89c1-d1b04f4e2648 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.862455] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.862455] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.862790] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.862948] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f13ce5-717c-44c7-89c1-d1b04f4e2648',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.957118] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5850f55-9492-4366-816e-5251bfefc2bb: rpc.has_security_group_logging(os_id): False [ 1020.980704] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.980867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.980941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.981179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.981268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.981914] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.982138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.982138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.982319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.982399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.982490] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5850f55-9492-4366-816e-5251bfefc2bb is going to be created. [ 1021.021572] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.021771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.021854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.022204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.022309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.022527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.022761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.022761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.022938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.022991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.023112] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 1021.045639] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.046258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.046258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.046258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.046468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.055269] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.055598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.055598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.055708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.055916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.069860] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1021.070879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: IN_PROGRESS for 2s [ 1021.130998] env[65511]: INFO networking_nsxv3.common.synchronization [req-2ae8b0c4-1e29-4b48-9f0f-0b322e343c53 req-f09ffff3-9753-4097-88d9-4d655e3eb31e tempest-ServersTestMultiNic-2109910679 tempest-ServersTestMultiNic-2109910679-project-member] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1021.132111] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGHEST for action security_group_members [ 1021.132111] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.132311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.316218] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.373433] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.373847] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.374018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.374435] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.374673] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.374941] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 99f13ce5-717c-44c7-89c1-d1b04f4e2648 not found, creating... [ 1021.375506] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.378416] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.378416] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.378416] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 99f13ce5-717c-44c7-89c1-d1b04f4e2648 is going to be created. [ 1021.409179] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.409582] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.409739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.410102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.410465] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.411071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.819420] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.190491] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1022.190748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.190908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.191212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.191465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.191622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.191712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.191915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.192077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.192205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.192331] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.203971] env[65511]: INFO networking_nsxv3.common.synchronization [req-76ce656f-eb7f-431f-8337-3cc6eb61860f req-33973cc0-0aa7-4f2a-b6a8-d6fe024faef9 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 1022.204237] env[65511]: INFO networking_nsxv3.common.synchronization [req-76ce656f-eb7f-431f-8337-3cc6eb61860f req-33973cc0-0aa7-4f2a-b6a8-d6fe024faef9 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1022.204428] env[65511]: INFO networking_nsxv3.common.synchronization [req-76ce656f-eb7f-431f-8337-3cc6eb61860f req-33973cc0-0aa7-4f2a-b6a8-d6fe024faef9 service nova] Enqueued Resource ID: 99f13ce5-717c-44c7-89c1-d1b04f4e2648 with Priority: HIGHEST for action port [ 1022.206687] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 1022.206687] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1022.206687] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99f13ce5-717c-44c7-89c1-d1b04f4e2648 with Priority: HIGHEST for action port [ 1022.207264] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.207264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.207264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.208244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.208437] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.210417] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.210568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.212430] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-99f13ce5-717c-44c7-89c1-d1b04f4e2648 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.212430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.212430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.212430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.212430] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99f13ce5-717c-44c7-89c1-d1b04f4e2648',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.323929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.324166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.324166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.324489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.324599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.324742] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1022.354340] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.354492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.354580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.354832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.354995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.365057] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1022.651097] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1022.651405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.695132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.695297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.696036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.696036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.696036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.696036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.696036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.696288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.696288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.696288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.696437] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.696539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.696591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.696741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.696922] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.697043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.697105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.697261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.697345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.697428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.697517] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.718600] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.718600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.719925] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99f13ce5-717c-44c7-89c1-d1b04f4e2648 with status ACTIVE [ 1022.720346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.720346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.720346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.720547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.720978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.720978] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.720978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.720978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.721190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.721292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.721445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.721528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.721584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.722154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.722154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.722154] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99f13ce5-717c-44c7-89c1-d1b04f4e2648 is going to be updated. [ 1022.746555] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.747163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.747163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.747163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.747400] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.747472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99f13ce5-717c-44c7-89c1-d1b04f4e2648" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.081847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1023.082046] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 1023.082166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.082336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.082561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.082748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.082864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.082928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.083097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.083178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.083271] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.084884] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: SUCCESS [ 1023.085091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.200498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 751af4d7-7958-43dc-a40b-b5e3493c4166: rpc.has_security_group_logging(os_id): False [ 1023.221163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.221355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.221355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.221577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.221666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.221857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.221956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.222028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.222193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.222269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.222452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.222534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.222595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.222733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.222806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.222998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.223105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.223164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.223369] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.223547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.223639] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1023.301416] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.301580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.301580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.301796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.302809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.318601] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1023.586947] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.089158] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.326033] env[65511]: INFO networking_nsxv3.common.synchronization [req-247211af-94d1-4094-8864-944c03575e3b req-d456615a-6a29-4d4c-b212-71234e35fd0b tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1024.326435] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1024.327145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.327145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.327145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.327453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.327453] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.327453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.327558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.327786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.327786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.327897] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.375675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1024.376722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.377031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.377298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.377493] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.377747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.377747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.377903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.377960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.378077] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.592508] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.593329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.593415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.593632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.593724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.593831] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 1024.627262] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.627624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.627624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.628029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.628029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.636375] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1024.644737] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.647033] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.647033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.647033] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.647033] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.647459] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.647459] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.647459] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.647547] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.647636] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.670192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.670192] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.670192] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.670192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.670192] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-f20d46f8-6bff-4c6d-9960-90dd47a1896f taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.670192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.670192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.670192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.670192] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20d46f8-6bff-4c6d-9960-90dd47a1896f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.830332] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.856577] env[65511]: INFO networking_nsxv3.common.synchronization [req-51b7cc7b-404c-4539-aad1-df7f473c8105 req-062c23eb-8fd5-4606-8de4-7f4c11ccad61 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 1024.857573] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 with Priority: HIGHEST for action security_group_members [ 1024.858025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.858284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.858284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.858489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.858717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.858912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.858960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.859151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.859288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.859715] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.880503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.880709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.880755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.881039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.881157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.881387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.881487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.881558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.881898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.881898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.882046] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be updated. [ 1024.911926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.912198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.912198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.912326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.912477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.922875] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: IN_PROGRESS for 2s [ 1025.172851] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.173015] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.173178] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.173433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.173592] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.173756] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port f20d46f8-6bff-4c6d-9960-90dd47a1896f not found, creating... [ 1025.174032] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.174216] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.174317] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.174547] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.174828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.175214] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.176204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.176204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.176204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.176204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.180165] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: f20d46f8-6bff-4c6d-9960-90dd47a1896f is going to be created. [ 1025.205297] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.205683] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.205935] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.206573] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.206680] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.207918] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.332396] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.338148] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1025.338148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.366027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.366027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.366027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.366027] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 is going to be updated. [ 1025.405480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.405688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.405736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.405950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.406103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.416516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: IN_PROGRESS for 2s [ 1025.836186] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.836409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.836462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.836701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.836920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.836963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be updated. [ 1025.871347] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.871536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.871579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.871778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.871933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.881343] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 1025.966445] env[65511]: INFO networking_nsxv3.common.synchronization [req-247211af-94d1-4094-8864-944c03575e3b req-70f5f4e3-dce0-41d5-b0ca-62e7c53f8cee service nova] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 1025.966445] env[65511]: INFO networking_nsxv3.common.synchronization [req-247211af-94d1-4094-8864-944c03575e3b req-70f5f4e3-dce0-41d5-b0ca-62e7c53f8cee service nova] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1025.966538] env[65511]: INFO networking_nsxv3.common.synchronization [req-247211af-94d1-4094-8864-944c03575e3b req-70f5f4e3-dce0-41d5-b0ca-62e7c53f8cee service nova] Enqueued Resource ID: f20d46f8-6bff-4c6d-9960-90dd47a1896f with Priority: HIGHEST for action port [ 1025.967706] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_rules [ 1025.967706] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1025.967706] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d46f8-6bff-4c6d-9960-90dd47a1896f with Priority: HIGHEST for action port [ 1025.968965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.968965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.968965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.968965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.968965] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.969833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.969833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.969833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f20d46f8-6bff-4c6d-9960-90dd47a1896f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.970066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.970066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.970619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.970724] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f20d46f8-6bff-4c6d-9960-90dd47a1896f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.475835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f20d46f8-6bff-4c6d-9960-90dd47a1896f with status ACTIVE [ 1026.475835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.475835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.475835] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.475835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.475835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f20d46f8-6bff-4c6d-9960-90dd47a1896f is going to be updated. [ 1026.477733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.477733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.500457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.500641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.500837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.500998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.501130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.501270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f20d46f8-6bff-4c6d-9960-90dd47a1896f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.648621] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1026.649282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.650246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.650246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.650246] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.650246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.650777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.651126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.651363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.652016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.652016] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.937166] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a82020c-f023-4af6-a870-9b8623205ed1 in Status: SUCCESS [ 1026.937421] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 deletion is rescheduled due to dependency. [ 1026.937616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.157029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.157029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.157029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.157029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.157029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.157029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.157029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.157452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.157452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.157452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.157452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.157601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.157601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.157748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.157896] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.158033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.158092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.158218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.158296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.158375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.158460] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.427593] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 in Status: SUCCESS [ 1027.427593] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8 deletion is rescheduled due to dependency. [ 1027.427849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.660779] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 1027.685222] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.685332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.685332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.685559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.685674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.686279] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.686279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.686279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.686279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.687013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.687013] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.687013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.687013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.687013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.687198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.687292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.687360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.687428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.687602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.687695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.687793] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 1027.755245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.755245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.755245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.755245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.755576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.774902] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1027.895050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 1027.895050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.895232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.895452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.895680] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.895799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.895869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.896136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.896136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.896304] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.400612] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.902823] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.920267] env[65511]: INFO networking_nsxv3.common.synchronization [None req-24b363d2-f509-4281-add9-8fca040c86b7 None None] Enqueued Resource ID: bba86086-8a3f-4235-98f7-2590962d3e0b with Priority: HIGHEST for action port [ 1028.920645] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba86086-8a3f-4235-98f7-2590962d3e0b with Priority: HIGHEST for action port [ 1028.920955] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bba86086-8a3f-4235-98f7-2590962d3e0b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.921091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bba86086-8a3f-4235-98f7-2590962d3e0b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.921156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bba86086-8a3f-4235-98f7-2590962d3e0b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.921399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bba86086-8a3f-4235-98f7-2590962d3e0b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.921472] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba86086-8a3f-4235-98f7-2590962d3e0b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.958614] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-2d976eec-5960-4848-b7dc-ee7ee19a09d4 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1028.959576] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1028.959901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.960600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.960756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.961275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.961432] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.961809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.962033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.962230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.962607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.962759] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.385943] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.386154] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.386268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.386713] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.386879] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.387064] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.387179] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.387946] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.387946] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.387946] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.387946] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.387946] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.388202] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.388202] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.388281] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.388368] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.405414] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.405540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.405607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.405840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.405939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.406056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be updated. [ 1029.412488] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.412676] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.412819] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.412999] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.415077] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-20006c45-b97d-4236-9492-bd82faed44e0 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.415347] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.415473] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.415860] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.416021] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20006c45-b97d-4236-9492-bd82faed44e0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.425288] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bba86086-8a3f-4235-98f7-2590962d3e0b [ 1029.425518] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.425653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.425722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.425931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.426061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.426124] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bba86086-8a3f-4235-98f7-2590962d3e0b already deleted. [ 1029.426205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bba86086-8a3f-4235-98f7-2590962d3e0b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.439764] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.439965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.439965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.441819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.441819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.448892] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 1029.466239] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.466410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.466481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.466709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.466806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.467204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.467269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.467434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.467514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467600] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 already deleted. [ 1029.467680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.800514] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1029.800685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.920246] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.920246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.920246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.920246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.920246] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.920246] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 20006c45-b97d-4236-9492-bd82faed44e0 not found, creating... [ 1029.922122] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.922122] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.922122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.922559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.922559] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 20006c45-b97d-4236-9492-bd82faed44e0 is going to be created. [ 1029.950905] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.951176] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.951349] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.951690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.951997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.952934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.141868] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1030.142530] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:2 started [ 1030.689230] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-6ced7b34-8bce-455a-a35c-05f60c115035 service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1030.689230] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-6ced7b34-8bce-455a-a35c-05f60c115035 service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1030.689230] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-6ced7b34-8bce-455a-a35c-05f60c115035 service nova] Enqueued Resource ID: 20006c45-b97d-4236-9492-bd82faed44e0 with Priority: HIGHEST for action port [ 1030.690643] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1030.691042] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1030.691352] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20006c45-b97d-4236-9492-bd82faed44e0 with Priority: HIGHEST for action port [ 1030.692240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.692637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.693930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.693930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.693930] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.694587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.694741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.695134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.696124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.696124] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.696124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.696124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.696381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.696504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.696572] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.698862] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-20006c45-b97d-4236-9492-bd82faed44e0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.698862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.698862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.698862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.698862] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20006c45-b97d-4236-9492-bd82faed44e0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.201983] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.201983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.201983] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.202720] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20006c45-b97d-4236-9492-bd82faed44e0 with status ACTIVE [ 1031.202959] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.203078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.203159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.203397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.203513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.203660] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.203767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.203852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.204022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.204123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.204307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.204419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.204494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.205251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.205251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.205376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20006c45-b97d-4236-9492-bd82faed44e0 is going to be updated. [ 1031.231469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.231641] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.231741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.232096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.232300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.232495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20006c45-b97d-4236-9492-bd82faed44e0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.460387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 1031.460559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.460734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.460964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.461177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.461298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.461298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.461298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.461298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.461298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.461298] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.554556] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-a20dec5a-af1d-44a0-b9e8-7e89e718acb4 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1031.555125] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1031.555474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.555620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.708467] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.940535] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.940866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.941059] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.941398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.941777] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.942112] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.942193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.943375] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.943700] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.943764] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.943894] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.944017] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.944150] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.944263] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.944377] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.944510] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.961479] env[65511]: INFO networking_nsxv3.common.synchronization [None req-6d8228f5-07d5-4b90-bf83-7121668cbc4e None None] Enqueued Resource ID: bc702631-1ff2-4a3f-890b-e88b42bbf0ce with Priority: HIGHEST for action port [ 1031.962272] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc702631-1ff2-4a3f-890b-e88b42bbf0ce with Priority: HIGHEST for action port [ 1031.962634] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc702631-1ff2-4a3f-890b-e88b42bbf0ce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.963343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc702631-1ff2-4a3f-890b-e88b42bbf0ce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.963343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc702631-1ff2-4a3f-890b-e88b42bbf0ce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.963343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc702631-1ff2-4a3f-890b-e88b42bbf0ce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.963343] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc702631-1ff2-4a3f-890b-e88b42bbf0ce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.964199] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.966409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.967500] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.967500] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.967500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.967500] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-bc592c52-eea3-4ace-b6ae-2c9edb288464 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.967500] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.967785] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.967937] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.968054] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc592c52-eea3-4ace-b6ae-2c9edb288464',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.211342] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.211682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.211682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.211877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.211952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.212039] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be created. [ 1032.239099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.239099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.239099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.239099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.239099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.248558] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: UNINITIALIZED for 2s [ 1032.469595] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc702631-1ff2-4a3f-890b-e88b42bbf0ce [ 1032.470079] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.470554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.470554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.470554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.470704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.470704] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc702631-1ff2-4a3f-890b-e88b42bbf0ce already deleted. [ 1032.470786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc702631-1ff2-4a3f-890b-e88b42bbf0ce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.472155] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83993e26-a536-4b93-ac9b-bdc8e2e16ee7: rpc.has_security_group_logging(os_id): False [ 1032.472285] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.472992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.472992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.472992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.472992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.473221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port bc592c52-eea3-4ace-b6ae-2c9edb288464 not found, creating... [ 1032.473314] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.473451] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.474113] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.474113] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.474113] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.474261] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.474492] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.474566] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.474841] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.475012] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.475161] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: bc592c52-eea3-4ace-b6ae-2c9edb288464 is going to be created. [ 1032.494591] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.494821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.494821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.494986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.495094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.495425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.495568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.495639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.495768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.495849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.495938] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be updated. [ 1032.501032] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.501032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.501032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.501032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.501385] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.501385] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.568242] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.569926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.569926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.569926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.569926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.585626] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 1033.313129] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-dc1b8604-2ad7-4fdc-8130-6289d481cd7d service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1033.313430] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-dc1b8604-2ad7-4fdc-8130-6289d481cd7d service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1033.313476] env[65511]: INFO networking_nsxv3.common.synchronization [req-013950c4-4925-4b38-adad-c9f9d06b3f6a req-dc1b8604-2ad7-4fdc-8130-6289d481cd7d service nova] Enqueued Resource ID: bc592c52-eea3-4ace-b6ae-2c9edb288464 with Priority: HIGHEST for action port [ 1033.314806] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1033.314806] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1033.314806] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc592c52-eea3-4ace-b6ae-2c9edb288464 with Priority: HIGHEST for action port [ 1033.314806] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.314806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.315367] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.315367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.315367] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc592c52-eea3-4ace-b6ae-2c9edb288464 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.315607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.315607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.315786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.315786] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc592c52-eea3-4ace-b6ae-2c9edb288464',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.820431] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc592c52-eea3-4ace-b6ae-2c9edb288464 with status ACTIVE [ 1033.820768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.820908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.821012] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.822752] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.822752] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.822752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.822752] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc592c52-eea3-4ace-b6ae-2c9edb288464 is going to be updated. [ 1033.927994] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.927994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.927994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.928466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.928466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.928602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc592c52-eea3-4ace-b6ae-2c9edb288464" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.260360] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1034.261295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.261295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.261295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.261525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.261525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.261525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.262667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.262667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.262667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.262667] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.263883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.263883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.263883] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.264131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.264243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.264492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.264650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.264906] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.604177] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 1034.607484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.766657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.766896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.768358] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.273749] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.314030] env[65511]: INFO networking_nsxv3.common.synchronization [req-ee48c7bc-6032-45fb-a1c2-be58eee67e53 req-d2975da5-98a4-4f45-ad5e-73c73716d41b tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1035.314886] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1035.315363] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.316474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.316474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.316474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.316474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.316474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.316474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.318189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.318189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.318189] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.775776] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.775776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.775776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.777040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.777040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.777040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1035.811216] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.812133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.812133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.812133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.812133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.820716] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.820799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.820799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.821058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.821211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.821427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.821566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.821603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.822401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.822401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.822401] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 1035.827411] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1035.861540] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.861540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.861540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.861540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.861540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.874331] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1037.838833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1037.839229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.839229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.839455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.839644] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.839765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.839845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.840032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.840117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.840209] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.885349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1037.885349] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 1037.885349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.343143] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.555676] env[65511]: INFO networking_nsxv3.common.synchronization [None req-d942fd7f-1dde-4aaf-8b82-06c682d6c35e tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1038.556390] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1038.557439] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.557439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.557439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.557684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.557846] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.558040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.558138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.558324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.558423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.558840] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.846307] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.848961] env[65511]: INFO networking_nsxv3.common.synchronization [req-e2db8b5d-7c80-40d7-84bc-f40ccb0617eb req-b624f623-3769-4792-9386-e3bb5dce1d5c tempest-ServerMetadataTestJSON-376678413 tempest-ServerMetadataTestJSON-376678413-project-member] Enqueued Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1038.849774] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1038.850188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.850310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.850380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.850872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.850872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.851015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.851015] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.851143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.851246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.851341] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.065248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.065493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.065611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.065923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.066116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.067960] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.067960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.067960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.067960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.067960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.067960] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1039.106143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.106143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.106143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.106143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.106143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.117062] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1039.339415] env[65511]: INFO networking_nsxv3.common.synchronization [req-e36c42f5-ab66-46bc-b456-0c74915d7724 req-883a7a8c-c1da-4762-9096-9970b77836c3 tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1039.341592] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1039.342251] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.342588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.342729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.343113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.343429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.343640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.343811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.344578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.344946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.345167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.350724] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.350905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.350905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.351284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.351381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.351508] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1039.356401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.356401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.356401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.356401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.356401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.356760] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.356957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.357275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.357619] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.358280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.358280] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 already deleted. [ 1039.358280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.433577] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.433784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.433784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.434053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.434384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.448822] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1039.756195] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.756522] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-769" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.757254] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-769" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.758030] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-769" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.759039] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.760991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.761154] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.761449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.761689] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.761844] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.761957] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.762080] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.762200] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.762307] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.762410] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.762557] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.786671] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.786671] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.786671] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.786671] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-769" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.787114] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-5f72f27c-fbe0-4813-ae42-c414f44d80fc taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.787114] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.787223] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.788536] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.788536] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f72f27c-fbe0-4813-ae42-c414f44d80fc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.852093] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.852093] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.852093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.852093] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 1039.894279] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.894458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.894458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.894736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.895293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.908282] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1040.290648] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.291656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.291656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.291826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.291989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.292157] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 5f72f27c-fbe0-4813-ae42-c414f44d80fc not found, creating... [ 1040.293116] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.293116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.293116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.293116] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.293408] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.293636] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.293839] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.293953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.294208] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.294452] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.294618] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 5f72f27c-fbe0-4813-ae42-c414f44d80fc is going to be created. [ 1040.331336] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.331584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.331662] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.331996] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.332684] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.332684] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.446592] env[65511]: INFO networking_nsxv3.common.synchronization [None req-98601560-a3a5-41a8-a20f-78f2f2713f61 None None] Enqueued Resource ID: 60fede95-bfd6-46f8-b4b6-7e722a9f68c0 with Priority: HIGHEST for action port [ 1040.447585] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fede95-bfd6-46f8-b4b6-7e722a9f68c0 with Priority: HIGHEST for action port [ 1040.448093] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-60fede95-bfd6-46f8-b4b6-7e722a9f68c0 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.448295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60fede95-bfd6-46f8-b4b6-7e722a9f68c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.448295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60fede95-bfd6-46f8-b4b6-7e722a9f68c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.448595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60fede95-bfd6-46f8-b4b6-7e722a9f68c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.448693] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60fede95-bfd6-46f8-b4b6-7e722a9f68c0',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.951076] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60fede95-bfd6-46f8-b4b6-7e722a9f68c0 [ 1040.951420] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.951557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.951557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.951756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.951862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.952185] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60fede95-bfd6-46f8-b4b6-7e722a9f68c0 already deleted. [ 1040.952185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60fede95-bfd6-46f8-b4b6-7e722a9f68c0" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.040042] env[65511]: INFO networking_nsxv3.common.synchronization [req-e2db8b5d-7c80-40d7-84bc-f40ccb0617eb req-04664b88-a2ab-4c51-8783-cb116243e040 service nova] Enqueued Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_rules [ 1041.040269] env[65511]: INFO networking_nsxv3.common.synchronization [req-e2db8b5d-7c80-40d7-84bc-f40ccb0617eb req-04664b88-a2ab-4c51-8783-cb116243e040 service nova] Enqueued Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1041.040361] env[65511]: INFO networking_nsxv3.common.synchronization [req-e2db8b5d-7c80-40d7-84bc-f40ccb0617eb req-04664b88-a2ab-4c51-8783-cb116243e040 service nova] Enqueued Resource ID: 5f72f27c-fbe0-4813-ae42-c414f44d80fc with Priority: HIGHEST for action port [ 1041.040877] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_rules [ 1041.041019] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1041.041614] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f72f27c-fbe0-4813-ae42-c414f44d80fc with Priority: HIGHEST for action port [ 1041.042381] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.042519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.042951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.043406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.043406] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.045699] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.045822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.045912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.046111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.046270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.046368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.046427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.046574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.046656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.046746] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.049882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f72f27c-fbe0-4813-ae42-c414f44d80fc taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.050025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.050071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.051052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.051052] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f72f27c-fbe0-4813-ae42-c414f44d80fc',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.122067] env[65511]: INFO networking_nsxv3.common.synchronization [req-e677142f-c75b-4bd0-a4ff-390c85bbe09e req-67e6ac4c-6916-48c9-a336-ec55202832d7 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 1041.122696] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2505d7-9740-4169-97c7-e850756cca9e with Priority: HIGHEST for action security_group_members [ 1041.124549] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad2505d7-9740-4169-97c7-e850756cca9e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.124549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.124549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.124769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.125188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.125398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.125505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.125991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.126185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.126363] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad2505d7-9740-4169-97c7-e850756cca9e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.133818] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1041.133818] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 deletion is rescheduled due to dependency. [ 1041.133818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.479875] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1041.480109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.480291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.480515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.481530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.481530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.481530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.482177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.482177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.482177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.482177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.482177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.482413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.482413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.482513] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.555203] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.555986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.556375] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.556831] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f72f27c-fbe0-4813-ae42-c414f44d80fc with status ACTIVE [ 1041.561436] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.561436] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.561436] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.561436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.561436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f72f27c-fbe0-4813-ae42-c414f44d80fc is going to be updated. [ 1041.577965] env[65511]: INFO networking_nsxv3.common.synchronization [req-5564d067-1c3e-4595-afd9-1885085560c6 req-fee9c235-223f-486b-9b16-d5f60d1c2804 tempest-InstanceActionsV221TestJSON-228910902 tempest-InstanceActionsV221TestJSON-228910902-project-member] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1041.578449] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1041.579558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.579558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.579746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.580805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.581189] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.581189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.581189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.581386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.581475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.581572] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.589881] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.589881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.589881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.589881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.589881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.589881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f72f27c-fbe0-4813-ae42-c414f44d80fc" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.630173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.630173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.634694] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.634694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.634694] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2505d7-9740-4169-97c7-e850756cca9e is going to be updated. [ 1041.681372] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.681372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.681372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.683756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.683756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.693935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: IN_PROGRESS for 2s [ 1041.919272] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1041.919537] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 1041.919660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.986473] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5cf34d-8c17-41c9-bf34-af48acdaf496: rpc.has_security_group_logging(os_id): False [ 1042.017398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.017558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.017637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.019567] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.019567] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.019567] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.019567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.020246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.020246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.020246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.020246] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be created. [ 1042.036602] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.036602] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-132" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.037826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-132" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.037826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-132" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.037826] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.037826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.037826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.038216] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.038303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.038514] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.038623] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.038728] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.038889] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.038942] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.039025] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.039156] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.063294] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.063514] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.063616] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.063800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-132" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.064770] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-b3764ac9-85ef-4fb6-9f19-880c459e175c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.064770] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.064770] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.064990] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.068519] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3764ac9-85ef-4fb6-9f19-880c459e175c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.068519] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.083389] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.083567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.083645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.083860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.083981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.084201] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.084314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.084378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.084601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.084697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.084796] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca already deleted. [ 1042.084891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.096623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.100024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.100024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.100024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.100024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.112163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1042.568766] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.568992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.569135] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.569434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.569581] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.569888] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port b3764ac9-85ef-4fb6-9f19-880c459e175c not found, creating... [ 1042.570190] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.570355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.570471] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.570690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.570822] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.571140] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.571297] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.571409] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.571614] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.571743] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.571877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: b3764ac9-85ef-4fb6-9f19-880c459e175c is going to be created. [ 1042.573159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.573285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.573362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.573526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.573607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.573695] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 is going to be created. [ 1042.604134] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.604609] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.604609] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.604785] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.605026] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.605258] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.606826] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.606994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.607184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.607284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.607428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.617884] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: UNINITIALIZED for 2s [ 1043.327779] env[65511]: INFO networking_nsxv3.common.synchronization [req-5564d067-1c3e-4595-afd9-1885085560c6 req-8cada99d-f061-4dc4-b2b8-93427c8bf5f3 service nova] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_rules [ 1043.328107] env[65511]: INFO networking_nsxv3.common.synchronization [req-5564d067-1c3e-4595-afd9-1885085560c6 req-8cada99d-f061-4dc4-b2b8-93427c8bf5f3 service nova] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1043.328107] env[65511]: INFO networking_nsxv3.common.synchronization [req-5564d067-1c3e-4595-afd9-1885085560c6 req-8cada99d-f061-4dc4-b2b8-93427c8bf5f3 service nova] Enqueued Resource ID: b3764ac9-85ef-4fb6-9f19-880c459e175c with Priority: HIGHEST for action port [ 1043.328663] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_rules [ 1043.328836] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1043.328940] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3764ac9-85ef-4fb6-9f19-880c459e175c with Priority: HIGHEST for action port [ 1043.334357] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.334357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.334357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.334357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.334357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.338662] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.338944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.339127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.339436] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.339797] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.339901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.339970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.341754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.343044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.343044] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.343559] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3764ac9-85ef-4fb6-9f19-880c459e175c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.344040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.344040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.344232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.344804] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3764ac9-85ef-4fb6-9f19-880c459e175c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.545977] env[65511]: INFO networking_nsxv3.common.synchronization [None req-3e39aa25-a47a-400f-816c-ef8bf2af9f78 tempest-ServerActionsV293TestJSON-25790149 tempest-ServerActionsV293TestJSON-25790149-project-member] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1043.552240] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1043.552240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.552240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.552240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.552240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.552240] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.709116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad2505d7-9740-4169-97c7-e850756cca9e in Status: SUCCESS [ 1043.709116] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad2505d7-9740-4169-97c7-e850756cca9e deletion is rescheduled due to dependency. [ 1043.709116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad2505d7-9740-4169-97c7-e850756cca9e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.797570] env[65511]: INFO networking_nsxv3.common.synchronization [None req-3dbb9904-9f73-4cce-93e1-4d624ff2800b tempest-ServerActionsV293TestJSON-25790149 tempest-ServerActionsV293TestJSON-25790149-project-member] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1043.797570] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1043.797570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.797570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.850186] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.851036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.851036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.851036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3764ac9-85ef-4fb6-9f19-880c459e175c with status ACTIVE [ 1043.851036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.852181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.853024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.853024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.853024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.853024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.853240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.853240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.853396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.853396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.853579] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.853663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.853719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.853856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.853925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.854059] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3764ac9-85ef-4fb6-9f19-880c459e175c is going to be updated. [ 1043.880861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.881038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.881135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.881425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.881647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.881845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3764ac9-85ef-4fb6-9f19-880c459e175c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.964252] env[65511]: INFO networking_nsxv3.common.synchronization [None req-c4dc5347-8759-45f4-8ec9-416337e21224 None None] Enqueued Resource ID: c84dbe65-4a50-4aca-8d16-5d0c49ec39c9 with Priority: HIGHEST for action port [ 1043.965365] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84dbe65-4a50-4aca-8d16-5d0c49ec39c9 with Priority: HIGHEST for action port [ 1043.965935] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84dbe65-4a50-4aca-8d16-5d0c49ec39c9 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.966335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84dbe65-4a50-4aca-8d16-5d0c49ec39c9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.966438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84dbe65-4a50-4aca-8d16-5d0c49ec39c9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.966797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84dbe65-4a50-4aca-8d16-5d0c49ec39c9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.966904] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84dbe65-4a50-4aca-8d16-5d0c49ec39c9',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.080656] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.080807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.080879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.081258] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.081516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.081516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba already deleted. [ 1044.081516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.081822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.081822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.081944] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.126599] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1044.126841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.127508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.127732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.127820] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.352734] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.469130] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c84dbe65-4a50-4aca-8d16-5d0c49ec39c9 [ 1044.469565] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.469711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.469781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.470009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.470183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.471045] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c84dbe65-4a50-4aca-8d16-5d0c49ec39c9 already deleted. [ 1044.471045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84dbe65-4a50-4aca-8d16-5d0c49ec39c9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.604957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.605176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.605236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.605442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.605505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.605578] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba already deleted. [ 1044.605660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.630052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.630052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.630052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.630248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.630570] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.631218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.631349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.631586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.631688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.631785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.632022] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.633947] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: SUCCESS [ 1044.634192] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.634401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.634554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.634692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.634797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.635358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.635748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.635897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.638288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.638638] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.857672] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.857672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.857672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.857672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.857672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.857672] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca is going to be created. [ 1044.886936] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.888399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.888399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.888399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.888399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.900471] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: UNINITIALIZED for 2s [ 1045.143556] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.143783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.143873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.147834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.147834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.147834] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.147834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.147834] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.148722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.148722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.148722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.148722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.148722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.149403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.149403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.149403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.149403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.149403] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.651525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5cf34d-8c17-41c9-bf34-af48acdaf496: rpc.has_security_group_logging(os_id): False [ 1045.653688] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 194fa0c5-1d79-49ff-a422-ac14c6d25717: rpc.has_security_group_logging(os_id): False [ 1045.675387] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.675387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.675387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.675387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.675721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.676017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.676238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.676351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.677780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.677937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.678207] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.678328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.678394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.678560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.678640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.678839] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.678952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.679106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.679291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.679415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.679512] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1045.683224] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.683346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.683434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.683600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.683683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.684420] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.684420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.684420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.684590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.684590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.685552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.685552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.685552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.685552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.685552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.685552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.685552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.685955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.685955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.685955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.686111] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 is going to be created. [ 1045.768775] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.768883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.769025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.769356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.769613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.772191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.772376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.772413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.772598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.772759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.796243] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: IN_PROGRESS for 2s [ 1045.800263] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1046.916914] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: SUCCESS [ 1046.917565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.917751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.918234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.918474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.918713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.918783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.918963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.919092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.919183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.919283] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.425280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.425280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.425280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.425280] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.425280] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.425962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.425962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.425962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.425962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.425962] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.605565] env[65511]: INFO networking_nsxv3.common.synchronization [req-3dc0f701-55b9-4bec-bdc0-733c6fdba9d3 req-c4dbf755-0b2a-49f7-859e-6406accbd26a tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1047.607770] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1047.607770] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.607770] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.607770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.608289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.608289] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.810056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: SUCCESS [ 1047.810251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.814988] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1047.815262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.927776] env[65511]: INFO networking_nsxv3.common.synchronization [req-93675b9a-cb3b-4f75-8df3-9e2e8ff28c34 req-353798d2-1a95-4bf7-8852-313f3472d255 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1047.928569] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1047.929019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.929252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.929252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.929461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.929696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.929809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.929809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.929973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.930104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.930104] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.931516] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93b960e-abb3-45de-8b0b-bd1536ab4bca: rpc.has_security_group_logging(os_id): False [ 1047.952242] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.953603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.953603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.953603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.954062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.954062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.954062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.954062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.954223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.954223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.954303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.954413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.954479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.954560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca is going to be created. [ 1047.988577] env[65511]: INFO networking_nsxv3.common.synchronization [req-aca10ee2-0ee2-4c6a-8673-33a1b6acea86 req-e817196f-22f9-4c17-bd31-68769a1d5e8a tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1047.989198] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1047.989564] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.989761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.028893] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.029106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.029149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.029345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.029570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.043814] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: IN_PROGRESS for 2s [ 1048.111213] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.111213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.111344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.111878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.111996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.112493] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.112493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.112493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.112679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.112679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.112762] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1048.144785] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.144981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.145104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.145396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.145554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.168277] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1048.436041] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.937906] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.440527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.440731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.440802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.441160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.441267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.441388] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1049.473999] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.473999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.473999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.474190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.474190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.483977] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1050.062512] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: SUCCESS [ 1050.062512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.178881] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1050.179080] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1050.179201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.559297] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8ec4f97a-0fdd-4f59-b279-6c65633a044e None None] Enqueued Resource ID: 1c499d36-6ed1-4b48-8669-95544bf9a6ed with Priority: HIGHEST for action port [ 1050.559931] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c499d36-6ed1-4b48-8669-95544bf9a6ed with Priority: HIGHEST for action port [ 1050.560930] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c499d36-6ed1-4b48-8669-95544bf9a6ed taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.561097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c499d36-6ed1-4b48-8669-95544bf9a6ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.561370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c499d36-6ed1-4b48-8669-95544bf9a6ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.561636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c499d36-6ed1-4b48-8669-95544bf9a6ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.561636] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c499d36-6ed1-4b48-8669-95544bf9a6ed',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.064333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c499d36-6ed1-4b48-8669-95544bf9a6ed [ 1051.064710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.064792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.066324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.066324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.066324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.066324] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c499d36-6ed1-4b48-8669-95544bf9a6ed already deleted. [ 1051.066324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c499d36-6ed1-4b48-8669-95544bf9a6ed" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.099057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.100262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.101041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.102149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.102149] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.496056] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1051.496056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.496195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.496536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.496793] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.496793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.496793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.496973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.497031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.497177] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.604167] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.000300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.000494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.000558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.000760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.000846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.001099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.001203] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.001404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.001502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.001638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.001767] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1052.027932] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.028092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.028187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.028409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.028557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.038013] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1052.107060] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.145395] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.148021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.148021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.149030] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.149542] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.149813] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.150055] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.150266] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.150476] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.150676] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.151352] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.172072] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.172072] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.172072] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.172072] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.172072] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.172369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.172369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.173069] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.173069] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e4038c-f4d0-45dc-814b-08e8b4b6ef28',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.609924] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1052.609924] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1052.674799] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.675027] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.675204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.675444] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.675611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.675782] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 not found, creating... [ 1052.676235] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.676235] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.676407] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.676567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.676728] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.677025] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.677281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.677344] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.677535] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.677937] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.677937] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 is going to be created. [ 1052.698722] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.698936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.699076] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.699367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.699712] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.699866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.258674] env[65511]: INFO networking_nsxv3.common.synchronization [req-fa78c215-d2aa-4009-8874-cda77b1d7d4c req-4a3d08c0-3e4c-46ca-96c0-5b66fd85101b tempest-ServersNegativeTestJSON-745606439 tempest-ServersNegativeTestJSON-745606439-project-member] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1053.259269] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1053.259652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.259800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.259877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.260129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.260300] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.260397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.260453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.261016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.261111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.261210] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.441294] env[65511]: INFO networking_nsxv3.common.synchronization [req-462bef90-3f3e-4a1e-a1d8-82ea8df480b2 req-4d2a0213-7d8a-4faa-ab39-514fb90edc77 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 1053.441959] env[65511]: INFO networking_nsxv3.common.synchronization [req-462bef90-3f3e-4a1e-a1d8-82ea8df480b2 req-4d2a0213-7d8a-4faa-ab39-514fb90edc77 service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1053.441959] env[65511]: INFO networking_nsxv3.common.synchronization [req-462bef90-3f3e-4a1e-a1d8-82ea8df480b2 req-4d2a0213-7d8a-4faa-ab39-514fb90edc77 service nova] Enqueued Resource ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with Priority: HIGHEST for action port [ 1053.442639] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 1053.442639] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1053.442639] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with Priority: HIGHEST for action port [ 1053.442916] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.442916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.443053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.443569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.443569] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.444289] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.444412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.444473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.444667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.444827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.444930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.444992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.445182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.445273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.445370] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.447048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.447048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.447048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.447048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.447048] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e4038c-f4d0-45dc-814b-08e8b4b6ef28',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.519648] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.519803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.519877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.520073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.534026] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1053.534947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.536087] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1053.577781] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.578427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.578427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.578427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.588999] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1053.588999] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.588999] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1053.644761] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.644991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.644991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.645339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.647139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.647318] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1053.725588] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.725743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.725791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.726018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.726322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.726583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1053.748502] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.749634] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.749634] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.749859] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.750131] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.750300] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.750412] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.750649] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.750789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.750989] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.751112] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.751216] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.751315] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.751416] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.751537] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.751635] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.762855] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.763142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.763142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.763299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.763357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.763510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.763605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.763663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.763806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.763882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.763962] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd already deleted. [ 1053.764055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.771846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.772031] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.772170] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.772342] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.772635] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.772798] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.772913] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.773230] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.773359] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe1c708-acd4-4f30-a848-f7bf0f0c376b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.820625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.820772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.820824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.821132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.822034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.822313] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1053.822639] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e5dfcc09-13b8-4365-8bfc-bcfd5a191d58', '751af4d7-7958-43dc-a40b-b5e3493c4166', '4f5cf34d-8c17-41c9-bf34-af48acdaf496', '08f1abb3-effb-4f78-bdf9-5bf8159bab78', 'adb88e63-b602-4823-96eb-a58a3e31f8a1', '93ea4ead-0c30-430c-9c90-be02d8f74d6d', 'a14e9010-f590-466d-8c69-6b5bba0f38f8', '647f1aad-d1e8-4e71-b6f5-f70e5b3b779e', 'c93b960e-abb3-45de-8b0b-bd1536ab4bca', '323c831e-3e57-4559-b403-13f13a8cf909', '58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502', '2226f194-d814-4c64-80d7-5b7c97e1019e', '64ff0f9f-a392-4fb0-b465-f891d95ca0f1', '22614963-faca-462c-8364-ac7ae98c2969', 'f4aa4c41-7e6c-4db5-9705-5907decf8f0a', '55791d1b-680e-4037-89f2-4b3bac998f5a', '60d953b3-c8b1-4f58-8b03-316370f64a75', '479f3d06-9c02-42eb-90b2-95e362b2945a', '3d2f242b-f07c-4860-9f69-67ee36089fce', '1790ab65-8d50-4bf4-aa35-1b139b74d5a6', 'c5850f55-9492-4366-816e-5251bfefc2bb', '83993e26-a536-4b93-ac9b-bdc8e2e16ee7', '9a82020c-f023-4af6-a870-9b8623205ed1', 'c75da86d-70ea-4fc8-86a4-c249315ae94c', '49eab9c1-0cf4-4ab1-83f1-830592c0f740', '0211564f-7b41-42e2-85dc-08114fde7981', '1bef7c22-495d-4b65-b8bf-57eb4115026b', '2777b4e0-28a1-4987-85d5-9f30569a8c3c', '1502e09d-ef5c-4d75-b759-794a7bb5c0cf', 'fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8', '897a9691-2826-4bf1-8977-6d7594c8df89', '194fa0c5-1d79-49ff-a422-ac14c6d25717', '1dd306dd-83f9-434d-a479-235e5cd1d98f', 'b0f00d64-0787-45ef-b61c-8c6c22be615c', '6f6d2b7b-7f21-42a2-84a8-572f5519d7d0', 'ee64cf57-98ae-44f7-84e3-20cf3c5c2489', 'a0614801-abc8-4a0a-a4f8-e0e682a1e02c', '95d278ea-5c85-431d-b2c5-e2b81a141e5f', '9441a081-4c23-4898-9876-4df61d261ed0', 'bc42862b-f71b-41f8-ad04-30546bed9ee5', 'b22e9f87-12dd-4e82-864b-ae5b61fc4413', 'ad2505d7-9740-4169-97c7-e850756cca9e', 'a7ce43c3-59e1-4b66-8efa-669b47d29012', '232b7b09-b30d-4f2e-95a8-0315ce8667b1', '9d28d366-53ef-44cf-aae9-28a5d620d19b', 'ab4de9da-a8ca-4370-af21-e316dc775aee', '964f8cb2-18ad-4766-ae61-bda439ab5514', 'c0746379-de9c-4dc8-baf1-40ed27bd5a2c', '48fd9074-e82c-4b2f-86bc-96c1badeaa2e', 'fd7e334b-4f27-4441-85ca-d5b22f8c8f07', '53044249-4154-4da6-ae48-a91634987f8e'} {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.822639] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1053.842795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.842950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.843048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.843328] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.843425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.843535] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1053.843630] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.843687] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1053.930424] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.931064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.931064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.931213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.932618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.932953] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1053.933073] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1053.933192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1053.933231] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1053.933315] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1053.933421] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 1053.933484] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGH for action security_group_rules [ 1053.933528] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGH for action security_group_rules [ 1053.933584] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGH for action security_group_rules [ 1053.933709] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGH for action security_group_rules [ 1053.933709] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGH for action security_group_rules [ 1053.933810] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGH for action security_group_rules [ 1053.933810] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGH for action security_group_rules [ 1053.933898] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGH for action security_group_rules [ 1053.933942] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 1053.933974] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGH for action security_group_rules [ 1053.934082] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGH for action security_group_rules [ 1053.934149] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGH for action security_group_rules [ 1053.934194] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGH for action security_group_rules [ 1053.934258] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 1053.934376] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGH for action security_group_rules [ 1053.934376] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGH for action security_group_rules [ 1053.934476] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGH for action security_group_rules [ 1053.934510] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGH for action security_group_rules [ 1053.934544] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 1053.934651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.948268] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.949371] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.949497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951266] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with status ACTIVE [ 1053.951394] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.951504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.951630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.951778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.951889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.952059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.952195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.952252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.952363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.952488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.952615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.952701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.952842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.952904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.952952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.953054] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 is going to be updated. [ 1053.978424] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.978590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.978659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.978907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.979092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.979271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.050186] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1054.050448] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 deletion is rescheduled due to dependency. [ 1054.050531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.276206] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.276584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.276584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.276823] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.276959] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.277136] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port dbe1c708-acd4-4f30-a848-f7bf0f0c376b not found, creating... [ 1054.277464] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.277616] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.277727] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.277940] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.278105] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.278493] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.278641] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.278805] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.279102] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.279250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.279385] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b is going to be created. [ 1054.302971] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.303358] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.303710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.304158] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.304653] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.305013] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.453086] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.955584] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.955749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.955823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.956067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.956160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.956260] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1054.986651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.986912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.987038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.987270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.987442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.996840] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1055.051856] env[65511]: INFO networking_nsxv3.common.synchronization [req-fa78c215-d2aa-4009-8874-cda77b1d7d4c req-bc2766be-e9c7-450c-b030-55de9ba183d2 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1055.052052] env[65511]: INFO networking_nsxv3.common.synchronization [req-fa78c215-d2aa-4009-8874-cda77b1d7d4c req-bc2766be-e9c7-450c-b030-55de9ba183d2 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1055.052203] env[65511]: INFO networking_nsxv3.common.synchronization [req-fa78c215-d2aa-4009-8874-cda77b1d7d4c req-bc2766be-e9c7-450c-b030-55de9ba183d2 service nova] Enqueued Resource ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b with Priority: HIGHEST for action port [ 1055.052840] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1055.052995] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1055.053622] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b with Priority: HIGHEST for action port [ 1055.053793] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 1055.053864] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGH for action security_group_rules [ 1055.053982] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 with Priority: HIGH for action security_group_rules [ 1055.054181] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 1055.054181] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 1055.054291] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGH for action security_group_rules [ 1055.054349] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGH for action security_group_rules [ 1055.054435] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 with Priority: HIGH for action security_group_rules [ 1055.054521] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGH for action security_group_rules [ 1055.054607] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55791d1b-680e-4037-89f2-4b3bac998f5a with Priority: HIGH for action security_group_rules [ 1055.054690] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 with Priority: HIGH for action security_group_rules [ 1055.054867] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226f194-d814-4c64-80d7-5b7c97e1019e with Priority: HIGH for action security_group_rules [ 1055.054867] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 with Priority: HIGH for action security_group_rules [ 1055.054988] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 1055.059182] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGH for action security_group_rules [ 1055.059439] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d with Priority: HIGH for action security_group_rules [ 1055.059439] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGH for action security_group_rules [ 1055.059575] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 with Priority: HIGH for action security_group_rules [ 1055.059667] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGH for action security_group_rules [ 1055.059756] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 with Priority: HIGH for action security_group_rules [ 1055.060809] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.060995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.061083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.061371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.061457] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.062434] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.062550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.062678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.062799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.063049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.063156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.063213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.063364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.063454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.063549] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.064518] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.064632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.064632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.064849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.064849] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe1c708-acd4-4f30-a848-f7bf0f0c376b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.065643] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.067162] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.067162] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.067162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.067162] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.068737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14e9010-f590-466d-8c69-6b5bba0f38f8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.068737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.068737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.068737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.068737] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14e9010-f590-466d-8c69-6b5bba0f38f8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.069670] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.069768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.069768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.069891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.070119] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.070737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.070849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.070849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.071059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.071113] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.071833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.071946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.072099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.072177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.072300] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.073070] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.073227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.073227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.073451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.073451] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.074262] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60d953b3-c8b1-4f58-8b03-316370f64a75 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.074360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.074360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.074510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.074635] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60d953b3-c8b1-4f58-8b03-316370f64a75',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.075303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.075448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.075507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.075604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.075671] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.076524] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55791d1b-680e-4037-89f2-4b3bac998f5a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.076756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.076756] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.076858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.076925] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55791d1b-680e-4037-89f2-4b3bac998f5a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.078207] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.078207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.079082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.079082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.079082] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64ff0f9f-a392-4fb0-b465-f891d95ca0f1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.079810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2226f194-d814-4c64-80d7-5b7c97e1019e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.079810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.079810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.079810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.079810] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2226f194-d814-4c64-80d7-5b7c97e1019e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.080580] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.080678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.080797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.081185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.081185] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.081631] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.081728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.081791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.081936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.082017] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.082742] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.082839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.082879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.085038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.085038] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.085038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.085038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.085038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.085038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.085038] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ea4ead-0c30-430c-9c90-be02d8f74d6d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.085345] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.085403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.085517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.085620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.085699] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.086660] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb88e63-b602-4823-96eb-a58a3e31f8a1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.086777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.086929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.087050] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb88e63-b602-4823-96eb-a58a3e31f8a1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.088034] env[65511]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1055.088034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.088034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.088218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.088218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.088318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.090049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.090049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.090049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.090049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.090049] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f1abb3-effb-4f78-bdf9-5bf8159bab78',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.093499] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.363883] env[65511]: INFO networking_nsxv3.common.synchronization [req-2514eed1-81de-4eff-982e-103ecd924e4a req-0bdf0dd8-b5bb-401b-aa8f-30576ffda5b8 tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1055.364473] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1055.364803] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.364930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.365030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.365405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.365625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.365973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.366092] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.366300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.366409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.366503] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.592035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.592254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.592311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.592501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.592671] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.592765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.592825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.592974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.593067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.593152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.593237] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.601861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.602105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.602191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.602427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.602626] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.602755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.602830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.603404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.603567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.603719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.603998] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.606701] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbe1c708-acd4-4f30-a848-f7bf0f0c376b with status ACTIVE [ 1055.606898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.607018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.607087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.607320] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.607450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.607594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.607693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.607802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.607923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.607959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.608380] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.608471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.608542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.608709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.608805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.608894] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b is going to be updated. [ 1055.611587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.611719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.612183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.612183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.612305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.612358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.612396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.612616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.612718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.612824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.612933] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.618966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.618966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.618966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.618966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.618966] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.619508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.619508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.619508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.619676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.619676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.619805] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.621553] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.621718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.623719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.623858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.623943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.624228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.624807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.624948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.625057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.625579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.625709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.625846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.625978] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.627707] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.689697] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.689867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.689913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.690187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.692484] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.692591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.709019] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.709242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.712265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.712433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.713354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.713521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.716851] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.716851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.723034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.726426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.726426] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.726426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.726426] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.726426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.726914] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.727059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.727897] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.728081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.731014] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.731014] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.731014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.731014] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.731014] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.731014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.733469] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.734059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.734225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.736497] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.737439] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.737439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.737439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.737678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.737678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.737915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.744975] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.745603] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.745755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.747510] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.748220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.748364] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64ff0f9f-a392-4fb0-b465-f891d95ca0f1 is going to be deleted. [ 1055.749804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.750314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.774036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.774036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60d953b3-c8b1-4f58-8b03-316370f64a75 is going to be deleted. [ 1055.774036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.774036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.802200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.802374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be deleted. [ 1055.803667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.803981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.838378] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.838598] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.838698] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.839086] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.839290] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.839442] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.839608] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.841103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.841103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.841265] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.841370] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.841556] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.841599] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.841678] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.842108] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.842108] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.843733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.843968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.844616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.844750] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be deleted. [ 1055.846030] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.846739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.846739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.846739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.846739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.846739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64ff0f9f-a392-4fb0-b465-f891d95ca0f1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.847057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.847371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.868695] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.868859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.883042] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.883042] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.883042] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.883042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-66" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.883042] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.883042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.883042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.883042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.883042] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.884736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.884736] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be deleted. [ 1055.885725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.886349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.933276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.933276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.934782] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.934923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.951119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.951221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be deleted. [ 1055.953214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.953346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.030309] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.030532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.036759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.036958] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55791d1b-680e-4037-89f2-4b3bac998f5a is going to be deleted. [ 1056.038406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.038542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.071696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.071696] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502 is going to be deleted. [ 1056.072798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.073017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.095848] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.106312] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.108501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.108501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.116112] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.119668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.119794] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb88e63-b602-4823-96eb-a58a3e31f8a1 is going to be deleted. [ 1056.121229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.121528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.122671] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.128882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.129034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.129116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.129338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.129503] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.129604] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.129705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.129826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.129911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.130017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.130178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.130247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.130374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.130430] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.130565] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.130650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.130708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.130844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.130917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.131076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.131117] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.132811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.132971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.133069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.133164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.134070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.134210] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be created. [ 1056.160694] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.160950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.185969] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.186149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.202022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.202022] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14e9010-f590-466d-8c69-6b5bba0f38f8 is going to be deleted. [ 1056.202022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.202022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.203651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.203651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.203651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.203948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.203948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.276531] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: UNINITIALIZED for 2s [ 1056.277050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.277175] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be deleted. [ 1056.278154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.278431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.280975] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.281131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.335232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.335232] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be deleted. [ 1056.335232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.335232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.389079] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.389463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.389655] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.390390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.390390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.390390] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece not found, creating... [ 1056.390813] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.391054] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.391225] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.391547] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.391744] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.392133] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.392390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.392568] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.392898] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.393144] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.393413] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece is going to be created. [ 1056.405910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.406253] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ea4ead-0c30-430c-9c90-be02d8f74d6d is going to be deleted. [ 1056.407446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.407796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.514126] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.514369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.514369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.514648] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.514879] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.515711] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.516850] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.516850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.520489] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.520648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.540476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.540637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f1abb3-effb-4f78-bdf9-5bf8159bab78 is going to be deleted. [ 1056.541681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.541912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.542027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.542170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60d953b3-c8b1-4f58-8b03-316370f64a75" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543008] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.543124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.543218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.543445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.543546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.544088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.598977] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 1056.610063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 479f3d06-9c02-42eb-90b2-95e362b2945a: rpc.has_security_group_logging(os_id): False [ 1056.618297] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d2f242b-f07c-4860-9f69-67ee36089fce: rpc.has_security_group_logging(os_id): False [ 1056.626040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 323c831e-3e57-4559-b403-13f13a8cf909: rpc.has_security_group_logging(os_id): False [ 1056.628072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.628223] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2226f194-d814-4c64-80d7-5b7c97e1019e is going to be deleted. [ 1056.629208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.629433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.629544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.629666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.630498] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.630613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.630681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.630851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.630940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.631073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ea4ead-0c30-430c-9c90-be02d8f74d6d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.631587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.631752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.631846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.631973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.632492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.632653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.632746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.632878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.633799] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.633918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.633982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.634172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.635794] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.635903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.636664] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93b960e-abb3-45de-8b0b-bd1536ab4bca: rpc.has_security_group_logging(os_id): False [ 1056.655982] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.656177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.682294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.682294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.687417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.687753] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.687854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.687912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.688145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.688265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.688395] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1056.689539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.689758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.689851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.689947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55791d1b-680e-4037-89f2-4b3bac998f5a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.690097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.690257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.690386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.690440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb88e63-b602-4823-96eb-a58a3e31f8a1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.690599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.690745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.690822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.690937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14e9010-f590-466d-8c69-6b5bba0f38f8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.691066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.691207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.691338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.691385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.692151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.692151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.692255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.692439] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.692558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.692625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.692763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.692830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.692919] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 1056.693882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.694051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.698692] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.698831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.768791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.768916] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.768983] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.769104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.769294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.769431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.769478] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a is going to be updated. [ 1056.770937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.771378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.771378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.771378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58422fb8-c7e3-4f7e-94ed-f1d4fcc2d502" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.771529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.771973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.784784] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.785024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.785024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.785301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.785629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.788419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.788419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.822110] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1056.825009] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.825222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.846648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.847053] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.847251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.847323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.847786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.847786] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.847786] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce is going to be updated. [ 1056.849113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.849357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.849455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.849556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.849706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.849886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.893178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.893366] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.931273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.931629] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.931750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.931826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.932187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.932187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.932266] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1056.934123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.934426] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.934576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.934779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f1abb3-effb-4f78-bdf9-5bf8159bab78" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.934959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.935230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.935332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.935751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2226f194-d814-4c64-80d7-5b7c97e1019e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.937246] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.937411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.937411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.937734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.937887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.938955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.939148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.968555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: IN_PROGRESS for 2s [ 1056.993761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.994197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.994347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.994418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.994913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.994913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995157] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.995295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.995409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.996310] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.996661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.998507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.998507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.998507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.998507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.998507] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca is going to be updated. [ 1056.999692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.999946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.001834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.021972] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1057.023753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.023753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.023753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.023753] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.023753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.023753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.024316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.024316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.024316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.024316] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.038532] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1057.122339] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.122553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.122605] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.122850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.123053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.131734] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.131929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.131977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.132189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.132343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.142044] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: IN_PROGRESS for 2s [ 1057.148099] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1057.158332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.158541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.158625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.158854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.159018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.178472] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: IN_PROGRESS for 2s [ 1057.222611] env[65511]: INFO networking_nsxv3.common.synchronization [req-2514eed1-81de-4eff-982e-103ecd924e4a req-d3be97cc-108e-4976-94db-078662de317f service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 1057.222800] env[65511]: INFO networking_nsxv3.common.synchronization [req-2514eed1-81de-4eff-982e-103ecd924e4a req-d3be97cc-108e-4976-94db-078662de317f service nova] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1057.222959] env[65511]: INFO networking_nsxv3.common.synchronization [req-2514eed1-81de-4eff-982e-103ecd924e4a req-d3be97cc-108e-4976-94db-078662de317f service nova] Enqueued Resource ID: 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece with Priority: HIGHEST for action port [ 1057.224236] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_rules [ 1057.224383] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1057.224484] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece with Priority: HIGHEST for action port [ 1057.224773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.224894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.224961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.225210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.225311] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.226265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.226390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.226554] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.226657] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.226717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.226897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.227016] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.497220] env[65511]: INFO networking_nsxv3.common.synchronization [req-8fee3be3-edec-417c-bc26-212a9238804a req-2a47a8aa-cff1-480a-b69d-7cd204148929 tempest-InstanceActionsV221TestJSON-228910902 tempest-InstanceActionsV221TestJSON-228910902-project-member] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1057.498782] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGHEST for action security_group_members [ 1057.500095] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.500250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.500319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.500533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.500708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.500804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.500867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.501014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.501105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.501198] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.529625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.529825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.529900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.530181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.530375] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.530472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.530536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.530695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.530777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.530885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.531132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.531281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.531405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.531592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.531746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.531846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.531905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.532068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.532151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.532235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.532329] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.729051] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.729051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.730237] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece with status ACTIVE [ 1057.730316] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.730585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.730585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.730701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.730785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.730963] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.731081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.731185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.731321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.731374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.731557] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.731649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.731709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.731847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.731920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.732010] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece is going to be updated. [ 1057.759470] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.759795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.759795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.759907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.760062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.760210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9a1e7b-9a4b-42a9-ac74-aa7df30fdece" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.004306] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.004503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.004549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.004729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.004821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005032] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.005162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.005233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.005411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.005468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.005541] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca is going to be updated. [ 1058.035429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.035582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.035717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.035807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.036589] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.037424] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7e334b-4f27-4441-85ca-d5b22f8c8f07: rpc.has_security_group_logging(os_id): False [ 1058.052414] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: IN_PROGRESS for 2s [ 1058.058687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.058876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.058946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.059288] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.079645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.080048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.080048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.080236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.080281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.080377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.080578] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.080680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.080795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.080882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.081020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.081161] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.081240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.081302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.081448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.081546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.081600] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1058.158494] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.158660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.158732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.158941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.159104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.171330] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1058.299037] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1058.299249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.299432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.299655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.299859] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.299977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.300057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.300212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.300298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.300386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.300479] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.802947] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.803383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.803383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.803507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.803769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.803902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.803902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.804106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.804347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.804347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.804532] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.804622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.804691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.804787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.805134] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.805134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.805134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.805559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.805559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.805559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.806035] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.834193] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1058.834193] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 1058.834193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.834344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.834502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.835613] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.835613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.835613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.835613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.835613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.835613] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.896163] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d4dfbe1-6f33-4934-aaea-bdac652d6c2f req-e1cb08c1-9a0a-421c-829e-ce6a41f1e38f tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1058.896163] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1058.896163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.896163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.896844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.897202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.897738] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.899481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.899841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.901082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.901082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.901082] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.986776] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: SUCCESS [ 1058.986776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.054539] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1059.054834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.164161] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1059.164424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.165373] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: SUCCESS [ 1059.165586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.197864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: SUCCESS [ 1059.198182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.307867] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1840945-a736-40d5-8bc9-389036bba1dd: rpc.has_security_group_logging(os_id): False [ 1059.339037] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.346505] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.350257] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.350257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.350257] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.353465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.353465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.353465] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be created. [ 1059.362183] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.362391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.362514] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.362782] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.363057] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.363206] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.363449] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.363564] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.363721] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.363931] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.364667] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.364945] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.364945] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.365122] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.365171] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.365284] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.399786] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.399965] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.400109] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.400299] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.400669] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.400937] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.401079] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.401565] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.401705] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad4095d-c1bd-4f10-b345-0ff3ee07644d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.403725] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.403725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.403725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.403725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.403725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.403997] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.403997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.404739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.404739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.404739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.404739] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be deleted. [ 1059.446178] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.446348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.446413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.446626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.447304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.449558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.449692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.449767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.449992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.450053] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.450135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.461163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1059.840219] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.907083] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.907083] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.907083] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.907594] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.907594] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.907740] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 7ad4095d-c1bd-4f10-b345-0ff3ee07644d not found, creating... [ 1059.908031] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.908196] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.908325] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.908602] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.908744] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.909062] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.909228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.909394] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.909558] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.909688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.909879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 7ad4095d-c1bd-4f10-b345-0ff3ee07644d is going to be created. [ 1059.933908] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.934202] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.934266] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.934534] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.934827] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.935072] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.065210] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca in Status: SUCCESS [ 1060.065451] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca deletion is rescheduled due to dependency. [ 1060.065582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.187791] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1060.188522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.346417] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.346666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.346666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.349718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.349718] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.349718] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 1060.385015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.385209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.385350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.385508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.385675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.397965] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1060.646855] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d4dfbe1-6f33-4934-aaea-bdac652d6c2f req-a4a20c54-7e23-4b4e-aac2-2a82cc244638 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1060.647026] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d4dfbe1-6f33-4934-aaea-bdac652d6c2f req-a4a20c54-7e23-4b4e-aac2-2a82cc244638 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1060.647348] env[65511]: INFO networking_nsxv3.common.synchronization [req-6d4dfbe1-6f33-4934-aaea-bdac652d6c2f req-a4a20c54-7e23-4b4e-aac2-2a82cc244638 service nova] Enqueued Resource ID: 7ad4095d-c1bd-4f10-b345-0ff3ee07644d with Priority: HIGHEST for action port [ 1060.649190] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1060.649190] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1060.649190] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad4095d-c1bd-4f10-b345-0ff3ee07644d with Priority: HIGHEST for action port [ 1060.649190] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.650323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.650469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.650815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.650815] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.654259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.654259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.654259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.655145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.655145] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.655461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.655461] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.655559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.655667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.655815] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.661890] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.661890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.661890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.661890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.662219] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad4095d-c1bd-4f10-b345-0ff3ee07644d',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.163921] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.165043] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.165216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.165588] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ad4095d-c1bd-4f10-b345-0ff3ee07644d with status ACTIVE [ 1061.165749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.165855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.166173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.166173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.166379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.166379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.166514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.166514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.166733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.166733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.166920] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.167052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.167052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.167413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.167413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.167413] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ad4095d-c1bd-4f10-b345-0ff3ee07644d is going to be updated. [ 1061.189665] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.189865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.189916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.190485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.190485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.190695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ad4095d-c1bd-4f10-b345-0ff3ee07644d" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.475644] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1061.475644] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.666860] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.170466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.170836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.170836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.170958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.171029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.171787] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be created. [ 1062.201783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.202051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.202195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.202498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.202797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.215981] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: UNINITIALIZED for 2s [ 1062.266730] env[65511]: INFO networking_nsxv3.common.synchronization [req-0810f2bb-531d-4161-957e-79adc4732bd5 req-407d812f-3978-4a40-982d-954fa8eabb86 tempest-ServerMetadataTestJSON-376678413 tempest-ServerMetadataTestJSON-376678413-project-member] Enqueued Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1062.267436] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 with Priority: HIGHEST for action security_group_members [ 1062.267784] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-194fa0c5-1d79-49ff-a422-ac14c6d25717 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.267923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.267992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.268213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.268422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.268529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.268585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.268745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.268888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.268933] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('194fa0c5-1d79-49ff-a422-ac14c6d25717',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.411064] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1062.411317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.411925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.412229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.412427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.412543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.412608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.412792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.412858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.412950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.413142] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.771403] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.771608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.771680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.771928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.802020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.802204] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.802204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.802415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.802477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.802537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.802606] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 is going to be updated. [ 1062.838322] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.838469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.838539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.838749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.838901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.850423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: IN_PROGRESS for 2s [ 1062.919427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.919427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.919427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.919427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.919427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.920349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.920349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.920349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.920349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.920349] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.423984] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aa4c41-7e6c-4db5-9705-5907decf8f0a: rpc.has_security_group_logging(os_id): False [ 1063.446027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.446027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.446267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.446267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.446363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.446569] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.446672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.446734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.446883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.446958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.447275] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.447390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.447464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.447612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.447688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.447874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.447967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.448041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.448181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.448253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448337] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be created. [ 1063.511805] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.512074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.512173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.513031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.513031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.532635] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1064.227719] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1064.227925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.228149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.228383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.228749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.228930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.229044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.229245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.229356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.229453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.229546] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.560454] env[65511]: INFO networking_nsxv3.common.synchronization [req-fb05ea50-188c-4ad2-8736-be03fc2cbaba req-f69e36fa-35a0-45d4-b493-7809bc24b859 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 1064.561163] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGHEST for action security_group_members [ 1064.561573] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.561757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.561853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.562119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.562746] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.562938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.563027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.563329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.563429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.563582] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.732624] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.732864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.732970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.734119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.734119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.734119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.734492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.734492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.734492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.734492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.734798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.734798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.734798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.734798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.734929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.734963] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.862053] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 in Status: SUCCESS [ 1064.862253] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 194fa0c5-1d79-49ff-a422-ac14c6d25717 deletion is rescheduled due to dependency. [ 1064.862965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-194fa0c5-1d79-49ff-a422-ac14c6d25717" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.066698] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.066905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.066946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.067163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.067259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.067701] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.067815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.067875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.068067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.068155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.068248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a is going to be updated. [ 1065.103535] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.103742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.103742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.103962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.104116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.115711] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: IN_PROGRESS for 2s [ 1065.240695] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 751af4d7-7958-43dc-a40b-b5e3493c4166: rpc.has_security_group_logging(os_id): False [ 1065.260229] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.260401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.260635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.260907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.260958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.261166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.261287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.261332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.261521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.261599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.261787] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.261880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.261935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.262100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.262175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.262376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.262472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.262550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.262769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.262869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.263015] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be created. [ 1065.331521] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.331673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.331745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.331961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.332166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.357140] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1065.547956] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1065.548214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.126958] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 479f3d06-9c02-42eb-90b2-95e362b2945a in Status: SUCCESS [ 1067.127298] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a deletion is rescheduled due to dependency. [ 1067.127298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.371984] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1067.371984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.368105] env[65511]: INFO networking_nsxv3.common.synchronization [req-89ae2615-d26f-476f-9380-84ddd8747acc req-b2017672-ca8c-4279-b46d-0781f8b48777 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 1069.368758] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c with Priority: HIGHEST for action security_group_members [ 1069.369431] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-2777b4e0-28a1-4987-85d5-9f30569a8c3c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.369431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.369431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.369431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.369644] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.369693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.369752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.370463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.370463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.370463] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2777b4e0-28a1-4987-85d5-9f30569a8c3c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.876557] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.880267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.880416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.880611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.908466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.908788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.908934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.909014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.909239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.909337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.909425] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c is going to be updated. [ 1069.946635] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.946860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.946860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.947125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.947271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.959989] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: IN_PROGRESS for 2s [ 1070.062529] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.062768] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.062921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.063243] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.063523] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.063683] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.063795] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.064029] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.064172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.064377] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.064487] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.064593] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.064696] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.064799] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.064898] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.065036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.085512] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.085512] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.085512] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.085512] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-556" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.085512] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.085512] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.085512] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.085512] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.085512] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e4038c-f4d0-45dc-814b-08e8b4b6ef28',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.587666] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.588039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.588039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.588127] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.589739] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.589739] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.589739] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.590346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.590346] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.590346] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 is going to be updated. [ 1070.612990] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.612990] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.613247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.613851] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.613851] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.614070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.339146] env[65511]: INFO networking_nsxv3.common.synchronization [req-91054fda-a4cb-478f-b064-8179d52f4866 req-7870a5ec-f906-4b1c-9746-1cc0520eb74f service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 1071.339146] env[65511]: INFO networking_nsxv3.common.synchronization [req-91054fda-a4cb-478f-b064-8179d52f4866 req-7870a5ec-f906-4b1c-9746-1cc0520eb74f service nova] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1071.339146] env[65511]: INFO networking_nsxv3.common.synchronization [req-91054fda-a4cb-478f-b064-8179d52f4866 req-7870a5ec-f906-4b1c-9746-1cc0520eb74f service nova] Enqueued Resource ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with Priority: HIGHEST for action port [ 1071.339505] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_rules [ 1071.339579] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1071.339640] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with Priority: HIGHEST for action port [ 1071.340188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.340314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.340391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.340612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.340701] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.342142] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.342142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.342142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.342142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.342142] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.342616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.342616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.342616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.342616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.342616] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.344958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.344958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.344958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.344958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.344958] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e4038c-f4d0-45dc-814b-08e8b4b6ef28',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.845217] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.849144] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.849338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.849454] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 with status ACTIVE [ 1071.849712] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.849859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.849859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.849996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.850101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.850277] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.850401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.850449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.850579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.850661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.850947] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.850947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.851055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.851168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.851235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.851307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e4038c-f4d0-45dc-814b-08e8b4b6ef28 is going to be updated. [ 1071.873346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.873610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.873610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.873763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.873905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.874089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e4038c-f4d0-45dc-814b-08e8b4b6ef28" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.974857] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c in Status: SUCCESS [ 1071.975064] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2777b4e0-28a1-4987-85d5-9f30569a8c3c deletion is rescheduled due to dependency. [ 1071.975166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2777b4e0-28a1-4987-85d5-9f30569a8c3c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.348326] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.852230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.852230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.853370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.853370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.853370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.853370] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1072.891797] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.892021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.892021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.892261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.892410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.904228] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1073.413024] env[65511]: INFO networking_nsxv3.common.synchronization [req-745bba80-63a9-4ef4-8b66-87920a889cfc req-33020715-4aa8-4b74-ad90-9a125822dd73 tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1073.413024] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1073.415209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.415414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.415534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.415761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.416482] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.416597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.416680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.416848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.416938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.417045] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.793470] env[65511]: INFO networking_nsxv3.common.synchronization [req-37861d91-487f-4def-bd0b-3ca909cb0bb3 req-cfc58e8b-9989-43eb-a23e-5ae0a5b646b4 tempest-ServersTestManualDisk-1702256595 tempest-ServersTestManualDisk-1702256595-project-member] Enqueued Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 1073.794329] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab4de9da-a8ca-4370-af21-e316dc775aee with Priority: HIGHEST for action security_group_members [ 1073.794469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab4de9da-a8ca-4370-af21-e316dc775aee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.794692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.794986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.795623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.796488] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.796488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.796488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.796667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.796667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.796752] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab4de9da-a8ca-4370-af21-e316dc775aee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.800510] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.801559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.801559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.801559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.801559] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.802053] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.802053] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.802593] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.802593] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.802757] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.802861] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.803033] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.803205] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.803379] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.804302] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.804302] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.831207] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.831388] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.831526] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.831702] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-618" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.832046] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-2cfb0ced-3bde-4782-ba57-a42671b7bf33 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.832295] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.832482] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.833218] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.836387] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cfb0ced-3bde-4782-ba57-a42671b7bf33',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.921634] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.922193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.922312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.922569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.922734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.923046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.923235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.923339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.923706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.923870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.924098] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be deleted. [ 1073.962198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.962376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.962443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.962693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.962808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.962912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.307038] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.307038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.307038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.307038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.339570] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.339570] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 2cfb0ced-3bde-4782-ba57-a42671b7bf33 not found, creating... [ 1074.339570] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.339570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.340333] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.340539] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.341021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.341353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.341571] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.342071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.342279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.342469] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 2cfb0ced-3bde-4782-ba57-a42671b7bf33 is going to be created. [ 1074.344676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.345037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.345220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.345319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.345578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.345707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.345828] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee is going to be updated. [ 1074.381988] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.382642] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.382934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.383426] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.383845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.384241] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.388276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.388491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.388617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.388868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.389090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.400876] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: IN_PROGRESS for 2s [ 1074.920177] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.920177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.920177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.920177] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.123035] env[65511]: INFO networking_nsxv3.common.synchronization [req-745bba80-63a9-4ef4-8b66-87920a889cfc req-8754218e-5a7a-4d3e-bca5-532f53cba002 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 1075.123035] env[65511]: INFO networking_nsxv3.common.synchronization [req-745bba80-63a9-4ef4-8b66-87920a889cfc req-8754218e-5a7a-4d3e-bca5-532f53cba002 service nova] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1075.123035] env[65511]: INFO networking_nsxv3.common.synchronization [req-745bba80-63a9-4ef4-8b66-87920a889cfc req-8754218e-5a7a-4d3e-bca5-532f53cba002 service nova] Enqueued Resource ID: 2cfb0ced-3bde-4782-ba57-a42671b7bf33 with Priority: HIGHEST for action port [ 1075.124438] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_rules [ 1075.124438] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1075.124438] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cfb0ced-3bde-4782-ba57-a42671b7bf33 with Priority: HIGHEST for action port [ 1075.124880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.124880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.125111] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.125169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.125231] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.126259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.126423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.128378] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.128378] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.128378] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cfb0ced-3bde-4782-ba57-a42671b7bf33 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.128378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.128378] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cfb0ced-3bde-4782-ba57-a42671b7bf33',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.422719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.422904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.422979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.423306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.423459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.423570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.423634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.424190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.424190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.424190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.424190] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.424190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.424515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.424515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.424599] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.424698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.424978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.425149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.425257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.425353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.425470] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.630105] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.631445] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.631445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.631715] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cfb0ced-3bde-4782-ba57-a42671b7bf33 with status ACTIVE [ 1075.631715] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.631715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.631932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.631994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.632129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.632368] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.632477] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.632554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.634071] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.634071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.634071] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cfb0ced-3bde-4782-ba57-a42671b7bf33 is going to be updated. [ 1075.658485] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.658682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.658682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.658904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.659059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.659227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cfb0ced-3bde-4782-ba57-a42671b7bf33" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.929061] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7e334b-4f27-4441-85ca-d5b22f8c8f07: rpc.has_security_group_logging(os_id): False [ 1075.949919] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.950160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.950245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.950448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.950544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.950812] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.950919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.950993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.951194] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.951262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.951438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.951611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.951611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.951745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.951847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.952423] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.952423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.952423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.952423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.952624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.952624] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1076.030187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.030399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.030399] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.030714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.030876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.048174] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1076.135894] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.421966] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab4de9da-a8ca-4370-af21-e316dc775aee in Status: SUCCESS [ 1076.422165] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab4de9da-a8ca-4370-af21-e316dc775aee deletion is rescheduled due to dependency. [ 1076.422342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab4de9da-a8ca-4370-af21-e316dc775aee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.640601] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.640791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.640837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.641085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.641226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.641280] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 1076.680655] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.680794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.680880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.681105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.681265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.695952] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: UNINITIALIZED for 2s [ 1078.065441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1078.065441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.707562] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1078.707562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.707753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.708933] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.708933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.708933] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.211045] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.211404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.211404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.211539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.211664] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.211765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.211823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.212011] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.212103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.212164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.212290] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.212377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.212429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.212727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.212970] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.213104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.213175] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.213684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.213684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.213684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.213684] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.718980] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1790ab65-8d50-4bf4-aa35-1b139b74d5a6: rpc.has_security_group_logging(os_id): False [ 1079.740483] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.740483] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.740483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.741086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.741086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.741086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.741086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.741228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.743534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.743534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.743534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.743534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.743534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.743534] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be created. [ 1079.834094] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.834251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.834317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.834673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.834673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.851646] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1080.126395] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1080.126928] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1080.664243] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f657c9be-d441-4e12-a771-d655e20260fe tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1080.666469] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1080.666469] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.666469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.666469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.666469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.666469] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.768244] env[65511]: INFO networking_nsxv3.common.synchronization [None req-8fe9946f-aabb-46ee-b310-7e4ab72649cf tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1080.768765] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1080.769150] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.769275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.189541] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.189541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.189541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.189541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.190122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.190122] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b036a1-0362-42df-881b-ee482df8f115 already deleted. [ 1081.190122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.190122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.190350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.190350] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.712018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.712018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.712018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.712018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.712018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.712018] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b036a1-0362-42df-881b-ee482df8f115 already deleted. [ 1081.712018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.871741] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1081.871741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.126870] env[65511]: INFO networking_nsxv3.common.synchronization [req-95447b71-9f3b-4201-99ba-83faa1d733ca req-72d9e3bf-397a-45a8-a03e-52d545de19b5 tempest-ServerActionsV293TestJSON-25790149 tempest-ServerActionsV293TestJSON-25790149-project-member] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1082.127467] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1082.127788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.127902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.127996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.128397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.128604] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.128707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.128707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.128871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.128956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.129063] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.518541] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.518826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-207" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.519094] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-207" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.519454] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-207" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.519878] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.520000] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.520062] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.520314] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.520466] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.520683] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.520791] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.520894] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.521060] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.521272] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.521403] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.521538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.542034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.542223] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.542386] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.542637] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-207" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.542957] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-7978c230-ba52-4415-95ea-d3ae98c56d7a taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.543178] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.543355] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.543808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.543948] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7978c230-ba52-4415-95ea-d3ae98c56d7a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.616513] env[65511]: INFO networking_nsxv3.common.synchronization [req-f2acd630-3c30-49d4-8008-32421b65769d req-53c88a40-530b-48e6-b0c3-c797ebbb0e67 tempest-ImagesTestJSON-1523159023 tempest-ImagesTestJSON-1523159023-project-member] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1082.617059] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGHEST for action security_group_members [ 1082.617370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.617492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.617559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.617831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.617989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.618104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.618159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.618316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.618398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.618491] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.631014] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.631014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.631014] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.631160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.631160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.631379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.631449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.631491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.631645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.631709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.631792] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba already deleted. [ 1082.631879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.048328] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.048620] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.048620] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.048987] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.053695] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.054093] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 7978c230-ba52-4415-95ea-d3ae98c56d7a not found, creating... [ 1083.054842] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.055040] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.055263] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.055673] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.055902] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.056408] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.056685] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.056879] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.057289] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.057595] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.057833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 7978c230-ba52-4415-95ea-d3ae98c56d7a is going to be created. [ 1083.081686] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.082016] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.082204] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.082567] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.082889] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.085120] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.121748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.121970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.121970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.122170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.122265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.122498] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.122601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.122650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.122815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.122881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.122998] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be updated. [ 1083.160775] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.160948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.161040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.161304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.161405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.172027] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: IN_PROGRESS for 2s [ 1083.811850] env[65511]: INFO networking_nsxv3.common.synchronization [req-95447b71-9f3b-4201-99ba-83faa1d733ca req-420aa600-b50b-4278-87b3-786ff365a7cf service nova] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1083.812025] env[65511]: INFO networking_nsxv3.common.synchronization [req-95447b71-9f3b-4201-99ba-83faa1d733ca req-420aa600-b50b-4278-87b3-786ff365a7cf service nova] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1083.812167] env[65511]: INFO networking_nsxv3.common.synchronization [req-95447b71-9f3b-4201-99ba-83faa1d733ca req-420aa600-b50b-4278-87b3-786ff365a7cf service nova] Enqueued Resource ID: 7978c230-ba52-4415-95ea-d3ae98c56d7a with Priority: HIGHEST for action port [ 1083.812674] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_rules [ 1083.812806] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1083.812900] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7978c230-ba52-4415-95ea-d3ae98c56d7a with Priority: HIGHEST for action port [ 1083.813197] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.813361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.813413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.813672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.813756] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.816940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.816940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.816940] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.816940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7978c230-ba52-4415-95ea-d3ae98c56d7a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.816940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.816940] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7978c230-ba52-4415-95ea-d3ae98c56d7a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.184477] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-449963c0-06df-4134-86a2-a081e80a0207 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1084.185495] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1084.185637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.185730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.185909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.186083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.186274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.186397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.186655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.186655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.186892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.187046] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.322028] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.322028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.322028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7978c230-ba52-4415-95ea-d3ae98c56d7a with status ACTIVE [ 1084.322028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.322028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.322028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.323191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.323491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.323679] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.324116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.324337] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.324563] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7978c230-ba52-4415-95ea-d3ae98c56d7a is going to be updated. [ 1084.350981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.351190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.351236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.351606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.351606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.351800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7978c230-ba52-4415-95ea-d3ae98c56d7a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.683203] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.683362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.683501] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.683771] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.684034] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.684247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.684401] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.684656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.684817] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.686768] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.686768] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.686768] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.686768] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.686768] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.686768] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.686768] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.691048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.691048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.691048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.691048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.691048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.691048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.691408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.691408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.691408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.691569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.691569] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be deleted. [ 1084.706822] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.706997] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.707162] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.707363] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.707651] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-aec6db12-c95e-41b4-8fbe-224b64a15e6b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.707921] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.708053] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.708551] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.708753] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aec6db12-c95e-41b4-8fbe-224b64a15e6b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.722393] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.722575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.722667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.722866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.722959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.723094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.827735] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.182255] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a in Status: SUCCESS [ 1085.182255] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a deletion is rescheduled due to dependency. [ 1085.182255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.213532] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.213896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.213896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.214190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.214343] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.214498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port aec6db12-c95e-41b4-8fbe-224b64a15e6b not found, creating... [ 1085.214759] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.214925] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.215257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.215536] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.215691] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.216020] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.216182] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.216296] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.216503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.216633] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.216769] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: aec6db12-c95e-41b4-8fbe-224b64a15e6b is going to be created. [ 1085.238804] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.239031] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.239162] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.239433] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.239656] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.239903] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.332815] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.332815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.332815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.333013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.333204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.333291] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba is going to be created. [ 1085.382270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.382409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.383029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.383029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.383029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.398014] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: UNINITIALIZED for 2s [ 1085.990741] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-ad9d8651-9725-4f48-910c-d3f18e180e0f service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1085.990964] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-ad9d8651-9725-4f48-910c-d3f18e180e0f service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1085.991135] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-ad9d8651-9725-4f48-910c-d3f18e180e0f service nova] Enqueued Resource ID: aec6db12-c95e-41b4-8fbe-224b64a15e6b with Priority: HIGHEST for action port [ 1085.991687] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1085.991841] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1085.991922] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec6db12-c95e-41b4-8fbe-224b64a15e6b with Priority: HIGHEST for action port [ 1085.992743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.993021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.993021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.993699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.993921] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.995479] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.996274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.996356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.996575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.996744] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.996845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.996918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.997115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.997202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.997297] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.999938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-aec6db12-c95e-41b4-8fbe-224b64a15e6b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.000158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.000424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.000424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.000611] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aec6db12-c95e-41b4-8fbe-224b64a15e6b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.500550] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.505020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aec6db12-c95e-41b4-8fbe-224b64a15e6b with status ACTIVE [ 1086.505326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.505459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.505526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.505751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.505837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.507051] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.507156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.507218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.507386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.507478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.508044] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.508044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.508044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.508245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.508312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.508414] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aec6db12-c95e-41b4-8fbe-224b64a15e6b is going to be updated. [ 1086.510116] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.510237] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.537717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.537717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.537717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.538065] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.538248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.538453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aec6db12-c95e-41b4-8fbe-224b64a15e6b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.726824] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-830030f3-dac0-45cf-8494-de19910ff8e7 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1086.726824] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1086.726824] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.726824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.012367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.167068] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.167257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.167403] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.167764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.168074] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.168221] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.168344] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.169764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.169764] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.169764] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.169764] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.169764] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.169764] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.169764] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.169764] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.170158] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.198776] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.198776] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.198776] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.198776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-809" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.198776] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-117cd9bc-a545-4f92-9269-7596ea9c4b2c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.199407] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.199407] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.199506] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.199570] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117cd9bc-a545-4f92-9269-7596ea9c4b2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.412179] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: SUCCESS [ 1087.412668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.413106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.413448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.415018] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.415018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.415018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.415018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.415018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.415018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.415018] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.514960] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.515385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.515385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.515621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.515763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.515915] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be created. [ 1087.546247] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.546464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.546562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.546854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.547093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.562498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: UNINITIALIZED for 2s [ 1087.703658] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.703915] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.704036] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.704297] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.705992] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.706231] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 117cd9bc-a545-4f92-9269-7596ea9c4b2c not found, creating... [ 1087.706537] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.706929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.706929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.707100] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.707285] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.707548] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.707836] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.707973] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.708482] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.709032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.709032] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 117cd9bc-a545-4f92-9269-7596ea9c4b2c is going to be created. [ 1087.734028] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.734028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.734028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.734028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.734028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.734028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.916922] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.423480] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd325407-ae36-43a1-abed-91fd5cc630ba: rpc.has_security_group_logging(os_id): False [ 1088.446305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.446648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.446648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.446749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.446888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.447070] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.447181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.447238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.447391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.447469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.447556] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba is going to be created. [ 1088.477181] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-0f4eca40-1dd0-472b-b9ce-005277ca6ca5 service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1088.477368] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-0f4eca40-1dd0-472b-b9ce-005277ca6ca5 service nova] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1088.477505] env[65511]: INFO networking_nsxv3.common.synchronization [req-0bb821b5-bcf2-4a82-b1cc-36dd311c22c0 req-0f4eca40-1dd0-472b-b9ce-005277ca6ca5 service nova] Enqueued Resource ID: 117cd9bc-a545-4f92-9269-7596ea9c4b2c with Priority: HIGHEST for action port [ 1088.478603] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_rules [ 1088.478841] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1088.479039] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117cd9bc-a545-4f92-9269-7596ea9c4b2c with Priority: HIGHEST for action port [ 1088.479376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.479505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.479703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.479808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.480370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-117cd9bc-a545-4f92-9269-7596ea9c4b2c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.480532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.480632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.480776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.480888] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117cd9bc-a545-4f92-9269-7596ea9c4b2c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.516845] env[65511]: INFO networking_nsxv3.common.synchronization [req-ae7af418-0f8c-4d3f-8848-c76a2b75c3ce req-18aaea5c-8765-41d2-8856-5c30104bf5ee tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1088.517462] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1088.517902] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.517997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.518558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.518875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.519179] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.519284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.519284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.519504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.519587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.519738] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.546412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.546654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.546708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.546957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.547177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.565597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: IN_PROGRESS for 2s [ 1088.983223] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 117cd9bc-a545-4f92-9269-7596ea9c4b2c with status ACTIVE [ 1088.983491] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.983615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.983615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.983988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.984109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.984309] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.984420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.984497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.984661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.984745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.985246] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.985246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.985246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.985507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.985507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.985846] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 117cd9bc-a545-4f92-9269-7596ea9c4b2c is going to be updated. [ 1089.012747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.013234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.013234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.013234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.013638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.013638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117cd9bc-a545-4f92-9269-7596ea9c4b2c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.023998] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.302917] env[65511]: INFO networking_nsxv3.common.synchronization [req-baa6a921-b903-4513-a31c-f215cade5c5a req-fb9c3072-0d90-4e38-aab2-3ae5c38b4369 tempest-ServersNegativeTestJSON-745606439 tempest-ServersNegativeTestJSON-745606439-project-member] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1089.302917] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1089.302917] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.302917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.302917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.302917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.303314] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.303314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.303314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.303432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.303746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.303746] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.529166] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.572369] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1089.572603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.573143] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.573529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.573529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.574067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.574067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.574067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.574067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.574067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.574348] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.574996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.575230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.575513] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.575513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.575513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.575723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.575723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.575817] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.672469] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.672561] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.672695] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.672977] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.673325] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.673528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.673653] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.673903] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.674107] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.674322] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.674432] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.674540] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.674643] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.674747] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.674849] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.674974] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.703423] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.703684] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.703816] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.703989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.704335] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-036e1ae1-21d4-4e7e-84f7-37f3137705df taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.704519] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.704595] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.704961] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.705116] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036e1ae1-21d4-4e7e-84f7-37f3137705df',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.808791] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.032574] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.032837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.032837] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.033078] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.033157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.033276] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be updated. [ 1090.064049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.064049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.064049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.064049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.064049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.073046] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 1090.078596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.078793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.079013] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.209791] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.212611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 036e1ae1-21d4-4e7e-84f7-37f3137705df not found, creating... [ 1090.212611] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.212611] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.213196] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.213499] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.214095] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.214468] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.214816] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.215116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 036e1ae1-21d4-4e7e-84f7-37f3137705df is going to be created. [ 1090.244075] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.244075] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.244075] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.244075] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.244899] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.246056] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.310907] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.582167] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: SUCCESS [ 1090.582614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.583819] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.817452] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.817659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.817730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.818061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.818171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.818290] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1090.853056] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.853365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.853513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.854245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.854506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.869305] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1090.953384] env[65511]: INFO networking_nsxv3.common.synchronization [req-baa6a921-b903-4513-a31c-f215cade5c5a req-342f1af6-021a-4c6a-8577-45bfab80d646 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1090.953639] env[65511]: INFO networking_nsxv3.common.synchronization [req-baa6a921-b903-4513-a31c-f215cade5c5a req-342f1af6-021a-4c6a-8577-45bfab80d646 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1090.953708] env[65511]: INFO networking_nsxv3.common.synchronization [req-baa6a921-b903-4513-a31c-f215cade5c5a req-342f1af6-021a-4c6a-8577-45bfab80d646 service nova] Enqueued Resource ID: 036e1ae1-21d4-4e7e-84f7-37f3137705df with Priority: HIGHEST for action port [ 1090.954594] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1090.956306] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1090.956306] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036e1ae1-21d4-4e7e-84f7-37f3137705df with Priority: HIGHEST for action port [ 1090.956306] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.956306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.956306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.956306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.956783] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.959083] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.959224] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.959789] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-036e1ae1-21d4-4e7e-84f7-37f3137705df taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.959925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.959975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.960202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.960306] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036e1ae1-21d4-4e7e-84f7-37f3137705df',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.086577] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.086738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.086797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.087034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.087218] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.087335] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1091.120182] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.120393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.120536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.120628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.120782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.131538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1091.462332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.462681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.462960] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 036e1ae1-21d4-4e7e-84f7-37f3137705df with status ACTIVE [ 1091.463232] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.463444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.463570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.463899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.464080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.464325] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.464534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.464678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.464933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.465110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.465363] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.465697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.465818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.466046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.466190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.466335] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 036e1ae1-21d4-4e7e-84f7-37f3137705df is going to be updated. [ 1091.488240] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.488538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.488682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.489076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.489335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.489705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-036e1ae1-21d4-4e7e-84f7-37f3137705df" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.084991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 1092.085244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.879763] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1092.879864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.880048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.880271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.880459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.880573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.880637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.880798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.880880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.881058] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.144221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1093.144498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.144498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.144708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.145254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.145254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.145254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.145391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.145908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.145908] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.383467] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.647465] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.885495] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.151087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.388843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.389000] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.389104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.389391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.389536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.389682] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1094.425402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.425540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.425617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.426060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.426306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.437471] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1094.653659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.653940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.654729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.654729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.654729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.654729] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1094.708365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.708590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.708662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.708890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.709073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.724867] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1095.956288] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1095.956753] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1096.447613] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1096.448041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.448266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.448558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.448827] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.448979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.449070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.449233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.449361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.449480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.449588] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.737622] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1096.737909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.738148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.738387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.738596] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.738721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.738789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.739000] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.739068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.739207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.739361] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.739490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.739592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.739754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.739938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.740085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.740172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.740380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.740501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.740626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.740765] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.953637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.954104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.954104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.955039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.955265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.955415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.955474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.955791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.955844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.956169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.956169] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.956340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.956340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.956628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.956628] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.956699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.956840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.956911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.956979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.957114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.957153] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.242988] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5cf34d-8c17-41c9-bf34-af48acdaf496: rpc.has_security_group_logging(os_id): False [ 1097.263940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.263940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.263940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.263940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.263940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.263940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.263940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.264332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.264332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.264332] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.264429] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.264521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.264580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.264719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.264844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.264965] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.265085] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.265182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.265259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.265322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.265406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be created. [ 1097.339748] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.339748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.339748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.339938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.340612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.359118] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1097.459675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1840945-a736-40d5-8bc9-389036bba1dd: rpc.has_security_group_logging(os_id): False [ 1097.489096] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.491064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.491064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.491064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.491522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.491522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.491694] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.491876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.491969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.492217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.492344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.492483] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1097.584793] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.584793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.584793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.585112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.585112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.604464] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1099.378402] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1099.378402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.378402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.378715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.378715] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.622744] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1099.622991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.882954] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.883727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.884018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.884424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.884705] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.885186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.885371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.886850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.888794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.888794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.888794] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.395017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.395017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.395017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.395017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.395017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.395670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.395670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.395670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.395670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.395670] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.476091] env[65511]: INFO networking_nsxv3.common.synchronization [req-48e99ec6-4efe-4aee-b964-c0bed6da2eda req-f3548a3e-ce44-41a5-a041-533fc9684f75 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1100.476893] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1100.477606] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.477606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.477606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.477606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.478488] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.478488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.478488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.478488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.478488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.478488] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.574163] env[65511]: INFO networking_nsxv3.common.synchronization [req-1e88a1c9-e4d8-4fc6-af09-d6b10dfc2bdf req-e8cbb782-42b3-4482-a253-89ed7957c2c6 tempest-MultipleCreateTestJSON-1322347958 tempest-MultipleCreateTestJSON-1322347958-project-member] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1100.574881] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGHEST for action security_group_members [ 1100.574881] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.574881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.896669] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5cf34d-8c17-41c9-bf34-af48acdaf496: rpc.has_security_group_logging(os_id): False [ 1100.918104] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.919404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.919517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.919737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.919835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.920119] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.920422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.920422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.920547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.920547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.920706] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.920706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.921034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.921034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.921171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.921228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.921325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.921374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.921600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.921671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.921755] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1100.981507] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.998854] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.000482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.000482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.000482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.000482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.027286] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1101.118383] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.118550] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.118705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.119041] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.119270] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.119421] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.119528] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.120080] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.120080] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.120169] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.120209] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.120349] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.120445] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.120601] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.120693] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.120777] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.143900] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.144228] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.144318] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.144552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.144957] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-84305d27-a359-4cf2-bb40-3aa05cd9277b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.145170] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.145293] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.145573] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.145709] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84305d27-a359-4cf2-bb40-3aa05cd9277b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.483416] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.650326] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.650604] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.650771] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.651103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.651720] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.651720] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.651991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.651991] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.652506] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.652506] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.652601] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.653400] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.653400] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.653400] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.653400] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.653537] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b is going to be updated. [ 1101.677485] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.677485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.677485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.677485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.677485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.677845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.988788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.988788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.988788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.988788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.988788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.988788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1102.018400] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.018532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.018579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.018767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.018906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.028555] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1102.361484] env[65511]: INFO networking_nsxv3.common.synchronization [req-220629ba-36f0-43de-a528-6256592d6b98 req-f3001d51-2fd6-4648-9c2c-05812a22060c service nova] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 1102.361678] env[65511]: INFO networking_nsxv3.common.synchronization [req-220629ba-36f0-43de-a528-6256592d6b98 req-f3001d51-2fd6-4648-9c2c-05812a22060c service nova] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 1102.361864] env[65511]: INFO networking_nsxv3.common.synchronization [req-220629ba-36f0-43de-a528-6256592d6b98 req-f3001d51-2fd6-4648-9c2c-05812a22060c service nova] Enqueued Resource ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b with Priority: HIGHEST for action port [ 1102.362503] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_rules [ 1102.362667] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 1102.362755] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b with Priority: HIGHEST for action port [ 1102.363183] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.363371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.363407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.363621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.363790] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.364769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.365075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.365075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.365210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.365292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.365387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.365440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.365581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.365664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.365750] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.366980] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-84305d27-a359-4cf2-bb40-3aa05cd9277b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.367134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.367216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.367396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.367519] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84305d27-a359-4cf2-bb40-3aa05cd9277b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.869951] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.870264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.870443] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.871658] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84305d27-a359-4cf2-bb40-3aa05cd9277b with status ACTIVE [ 1102.871859] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.871991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.872113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.872361] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.872452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.872641] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.872740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.872801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.872950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.880661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.880661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.880661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.880661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.880661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.880661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.880661] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84305d27-a359-4cf2-bb40-3aa05cd9277b is going to be updated. [ 1102.909346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.909537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.909610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.914932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.914932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.914932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84305d27-a359-4cf2-bb40-3aa05cd9277b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.055439] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1103.055671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.227204] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e001bb8e-761c-437c-af8e-a152aae44312 None None] Enqueued Resource ID: 74c9fb24-bfea-4b97-b672-ce6e87743983 with Priority: HIGHEST for action port [ 1103.227204] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c9fb24-bfea-4b97-b672-ce6e87743983 with Priority: HIGHEST for action port [ 1103.227204] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c9fb24-bfea-4b97-b672-ce6e87743983 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.227204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c9fb24-bfea-4b97-b672-ce6e87743983" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.227204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c9fb24-bfea-4b97-b672-ce6e87743983" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.227204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c9fb24-bfea-4b97-b672-ce6e87743983" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.227204] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c9fb24-bfea-4b97-b672-ce6e87743983',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.384170] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.603065] env[65511]: INFO networking_nsxv3.common.synchronization [req-3966628d-774c-432e-a20f-65cff943c74d req-c8ed8af6-a508-43ab-99c8-de29ef1bdf93 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1103.603065] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1103.604048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.604048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.604048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.604048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.604318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.604398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.604512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.605108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.605108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.605108] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.732189] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74c9fb24-bfea-4b97-b672-ce6e87743983 [ 1103.732189] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.732189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.732189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.732189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.732189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.732189] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74c9fb24-bfea-4b97-b672-ce6e87743983 already deleted. [ 1103.732189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c9fb24-bfea-4b97-b672-ce6e87743983" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.888897] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.888897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.888897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.888897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.888897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.888897] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be updated. [ 1103.926495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.926686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.926752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.926979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.927159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.941238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: IN_PROGRESS for 2s [ 1104.005941] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.006177] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.006315] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.006636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.009996] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.010353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.010511] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.010804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.010948] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.011201] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.011312] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.011416] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.011518] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.011625] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.011731] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.011893] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.041417] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1104.041771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.042042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.042957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.042957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.042957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.042957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.042957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.043382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.043382] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.048538] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.048842] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.049378] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.049378] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.049873] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4163e4c2-915b-4edb-817d-dd23d63ad753 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.050155] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.050294] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.050924] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.050924] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4163e4c2-915b-4edb-817d-dd23d63ad753',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.107536] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.107790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.107897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.108200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.108296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.108533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.108624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.108702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.109173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.109173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.109173] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b036a1-0362-42df-881b-ee482df8f115 already deleted. [ 1104.109173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.549048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.549330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.549473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.549796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.549978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.550149] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.550924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.550924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.550924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.550924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.550924] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be updated. [ 1104.552532] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.552714] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.552828] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.553128] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.553267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.553406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4163e4c2-915b-4edb-817d-dd23d63ad753 not found, creating... [ 1104.553663] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.553807] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.553917] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.559213] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.559213] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.559213] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4163e4c2-915b-4edb-817d-dd23d63ad753 is going to be created. [ 1104.582115] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.582115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.582115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.582115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.582115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.582115] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.584072] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.584354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.584513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.584795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.585353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.600217] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: IN_PROGRESS for 2s [ 1105.276551] env[65511]: INFO networking_nsxv3.common.synchronization [req-3966628d-774c-432e-a20f-65cff943c74d req-7944e8f9-e95e-4df3-b11e-a4badf231810 service nova] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1105.276962] env[65511]: INFO networking_nsxv3.common.synchronization [req-3966628d-774c-432e-a20f-65cff943c74d req-7944e8f9-e95e-4df3-b11e-a4badf231810 service nova] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1105.277158] env[65511]: INFO networking_nsxv3.common.synchronization [req-3966628d-774c-432e-a20f-65cff943c74d req-7944e8f9-e95e-4df3-b11e-a4badf231810 service nova] Enqueued Resource ID: 4163e4c2-915b-4edb-817d-dd23d63ad753 with Priority: HIGHEST for action port [ 1105.277938] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_rules [ 1105.278205] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1105.278408] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4163e4c2-915b-4edb-817d-dd23d63ad753 with Priority: HIGHEST for action port [ 1105.278651] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.278848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.279468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.279468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.279468] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.281086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.281222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.281289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.281496] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.283318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.283318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.283318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4163e4c2-915b-4edb-817d-dd23d63ad753 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.283318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.283318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4163e4c2-915b-4edb-817d-dd23d63ad753',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.403285] env[65511]: INFO networking_nsxv3.common.synchronization [req-a967cd35-2a37-475b-840d-7784ea5ce145 req-2a11c585-d6db-4155-b977-35e4302338dc tempest-ServersNegativeTestJSON-745606439 tempest-ServersNegativeTestJSON-745606439-project-member] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1105.403862] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1105.404190] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.404315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.404382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.404579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.404729] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.404908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.404908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.406089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.406577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.406577] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.779783] env[65511]: INFO networking_nsxv3.common.synchronization [None req-0fca0e5a-c396-480c-a60a-2a790806b7f8 None None] Enqueued Resource ID: 8c2cd037-83f5-48d4-be0b-ad4bdb2e0842 with Priority: HIGHEST for action port [ 1105.780276] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c2cd037-83f5-48d4-be0b-ad4bdb2e0842 with Priority: HIGHEST for action port [ 1105.781070] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c2cd037-83f5-48d4-be0b-ad4bdb2e0842 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.781070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c2cd037-83f5-48d4-be0b-ad4bdb2e0842" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.781070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c2cd037-83f5-48d4-be0b-ad4bdb2e0842" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.781070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c2cd037-83f5-48d4-be0b-ad4bdb2e0842" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.781274] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c2cd037-83f5-48d4-be0b-ad4bdb2e0842',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.788192] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.788442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.788597] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.789497] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4163e4c2-915b-4edb-817d-dd23d63ad753 with status ACTIVE [ 1105.789677] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.789787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.789854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.790055] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.790146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.790310] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.790447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.790523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.790675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.790753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.790935] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.791039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.791098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.791235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.791304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.791387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4163e4c2-915b-4edb-817d-dd23d63ad753 is going to be updated. [ 1105.815928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.816135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.816212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.816374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.816513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.816706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4163e4c2-915b-4edb-817d-dd23d63ad753" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.911433] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.953422] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: SUCCESS [ 1105.953422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.954167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.954167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.954167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.954291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.954335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.954966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.954966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.954966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.954966] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.282801] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c2cd037-83f5-48d4-be0b-ad4bdb2e0842 [ 1106.283084] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.283182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.283252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.283457] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.283543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.283635] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c2cd037-83f5-48d4-be0b-ad4bdb2e0842 already deleted. [ 1106.283727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c2cd037-83f5-48d4-be0b-ad4bdb2e0842" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.293271] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.413592] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.457301] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.615142] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 in Status: SUCCESS [ 1106.615373] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 deletion is rescheduled due to dependency. [ 1106.615499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.795950] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.796133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.796217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.796801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.796801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796801] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b036a1-0362-42df-881b-ee482df8f115 is going to be created. [ 1106.825972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.826165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.826202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.827116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.827116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.836874] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: UNINITIALIZED for 2s [ 1106.916757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.917145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.917145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.917674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.917674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.917674] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1106.957958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.958148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.958382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.958491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.958617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.962990] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22614963-faca-462c-8364-ac7ae98c2969: rpc.has_security_group_logging(os_id): False [ 1106.970086] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1106.982388] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.983632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.983632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.984448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.984448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.984448] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be created. [ 1107.066427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.066626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.066717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.067026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.067300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.084847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: IN_PROGRESS for 2s [ 1108.846759] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: SUCCESS [ 1108.847119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.847225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.847900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.847900] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.847900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.847900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.847900] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.848264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.848264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.848264] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.979482] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1108.979634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.098584] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: SUCCESS [ 1109.098822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.350102] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.855457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6b036a1-0362-42df-881b-ee482df8f115: rpc.has_security_group_logging(os_id): False [ 1109.878120] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.878307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.878380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.878596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.878686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.879853] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.879853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.879853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.879853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.879853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.879853] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6b036a1-0362-42df-881b-ee482df8f115 is going to be created. [ 1109.949245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.949429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.949473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.949696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.949904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.983277] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: IN_PROGRESS for 2s [ 1110.784486] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1110.784730] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1112.000039] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: SUCCESS [ 1112.000389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.768372] env[65511]: INFO networking_nsxv3.common.synchronization [req-026366c9-8659-4f8e-b877-4faee18b76ac req-0fb1b977-4469-4b26-a0d8-d34ca88d7632 tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1112.770466] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGHEST for action security_group_members [ 1112.770466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.770466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.770466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.770466] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.272277] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.272630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.272630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.272794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.299343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.299614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.299730] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.299810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.300013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.300094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.300185] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be updated. [ 1113.336150] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.336228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.336259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.336537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.336698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.352504] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: IN_PROGRESS for 2s [ 1115.251153] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ffbd41c-1c34-43c8-a216-c19cfb1f2e44 req-852905c7-dae0-4cd4-acd9-6dda8d3aa51b tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1115.251860] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1115.252237] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.252667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.252744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.252935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.253108] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.253616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.253722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.253850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.253945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.254033] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.364803] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 in Status: SUCCESS [ 1115.364803] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 deletion is rescheduled due to dependency. [ 1115.364803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.606670] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.606873] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.607039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.607370] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.607629] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.607781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.607894] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.608192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.608585] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.608646] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.608726] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.608834] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.608953] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.609089] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.609193] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.609353] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.627902] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.628071] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.628275] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.628460] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.628887] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.629044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.629196] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.629563] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.629730] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97d0d4bc-9970-43a5-b84f-69a1e5b5bd59',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.755964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.756236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.756313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.756530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.756611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.756812] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.756908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.756971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.757136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.757215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.757299] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be deleted. [ 1115.791110] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.791319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.791388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.791773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.791773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.791881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.132371] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.132695] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.132804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.133103] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.133252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.133409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 not found, creating... [ 1116.133677] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.133827] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.133941] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.134183] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.134318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.134597] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.134748] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.134860] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.135078] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.135318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.135554] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 is going to be created. [ 1116.163177] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.163411] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.163607] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.163934] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.164221] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.164529] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.545948] env[65511]: INFO networking_nsxv3.common.synchronization [req-eaa2c04b-467b-46d8-9102-ec209e931713 req-c82ce814-1168-44af-bdff-35256e1e5032 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1116.546644] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1116.546983] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.547123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.547193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.547393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.547546] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.547642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.547702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.547849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.547935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.548042] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.879114] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ffbd41c-1c34-43c8-a216-c19cfb1f2e44 req-f64e2163-4ab6-4d4d-b1ff-30f9dac31557 service nova] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_rules [ 1116.879318] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ffbd41c-1c34-43c8-a216-c19cfb1f2e44 req-f64e2163-4ab6-4d4d-b1ff-30f9dac31557 service nova] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1116.879461] env[65511]: INFO networking_nsxv3.common.synchronization [req-6ffbd41c-1c34-43c8-a216-c19cfb1f2e44 req-f64e2163-4ab6-4d4d-b1ff-30f9dac31557 service nova] Enqueued Resource ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with Priority: HIGHEST for action port [ 1116.880287] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_rules [ 1116.882177] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1116.882177] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with Priority: HIGHEST for action port [ 1116.882177] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.882843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.882843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.883155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.883298] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.887883] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.887883] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.887883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.887883] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.891856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.891856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.891856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.891856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.891856] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97d0d4bc-9970-43a5-b84f-69a1e5b5bd59',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.051246] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.051401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.051469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.052816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.077901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.078193] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.078316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.078378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.080034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.080034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.080034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1117.106769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.106926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.106975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.107205] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.107340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.118353] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1117.395033] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with status ACTIVE [ 1117.395329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.395627] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.395708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.395955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.396235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.396492] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.396612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.396680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.396858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.396942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.397156] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.397255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.397318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.397468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.397544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.397628] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 is going to be updated. [ 1117.398869] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.400608] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.400752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.438739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.440144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.440144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.440144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.440144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.440144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.902436] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.405340] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.405582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.405654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.406119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.406119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.406119] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be created. [ 1118.430507] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.430744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.430744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.430925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.431097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.444031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: UNINITIALIZED for 2s [ 1119.130927] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1119.131191] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c deletion is rescheduled due to dependency. [ 1119.131245] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.453835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 1120.454235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.454235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.454439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.454635] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.454759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.454822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.454979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.455071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.455152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.455311] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.957909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.957909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.957909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.957909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.958150] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.958235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.958322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.958490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.958764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.958764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.958886] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.959476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.959476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.959476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.959476] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.959476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.959476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.959824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.959824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.959824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.959961] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.462653] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e: rpc.has_security_group_logging(os_id): False [ 1121.482154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.482154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.482154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.482154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.482675] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.482675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.482675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.482675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.482675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.482885] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be created. [ 1121.566187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.566187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.566187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.566187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.566187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.582321] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: IN_PROGRESS for 2s [ 1121.658181] env[65511]: INFO networking_nsxv3.common.synchronization [req-2cc1c101-45c6-4e06-a33f-7e3a1eaffe66 req-c80d2c08-c066-420e-8869-3d84cc197f0c tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1121.658812] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1121.659143] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.659680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.659809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.660115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.660319] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.660458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.660611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.660818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.660936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.661093] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.018250] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.018456] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-35" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.018579] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-35" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.018980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-35" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.019350] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.019518] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.019646] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.019871] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.020018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.020224] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.020335] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.020439] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.020579] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.020702] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.020821] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.020979] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.042119] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.042348] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.042490] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.042702] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-35" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.043032] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-938e860b-bfa7-49b7-8d16-cb74ebea2870 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.043212] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.043330] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.043645] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.043780] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938e860b-bfa7-49b7-8d16-cb74ebea2870',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.166077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.166343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.166343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.166535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.166687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.166864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.166956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.167022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.167187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.167264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.167350] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 already deleted. [ 1122.167431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.545895] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.546273] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.546331] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.546705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.546857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.547018] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 938e860b-bfa7-49b7-8d16-cb74ebea2870 not found, creating... [ 1122.547302] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.547460] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.547573] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.547816] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.547955] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.548269] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.548434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.548549] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.548776] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.548910] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.549058] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 is going to be created. [ 1122.570466] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.570645] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.570688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.570941] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.571182] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.571406] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.312653] env[65511]: INFO networking_nsxv3.common.synchronization [req-2cc1c101-45c6-4e06-a33f-7e3a1eaffe66 req-eb1a3b56-721a-4828-a9b9-896886da259c service nova] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1123.312831] env[65511]: INFO networking_nsxv3.common.synchronization [req-2cc1c101-45c6-4e06-a33f-7e3a1eaffe66 req-eb1a3b56-721a-4828-a9b9-896886da259c service nova] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1123.312967] env[65511]: INFO networking_nsxv3.common.synchronization [req-2cc1c101-45c6-4e06-a33f-7e3a1eaffe66 req-eb1a3b56-721a-4828-a9b9-896886da259c service nova] Enqueued Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1123.313541] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1123.313683] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1123.313832] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1123.314153] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.314248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.314248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.314546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.314625] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.315511] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.315613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.315674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.315846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.315989] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.316096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.316178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.316365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.316455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.316516] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.317265] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-938e860b-bfa7-49b7-8d16-cb74ebea2870 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.317386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.317444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.317577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.317647] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938e860b-bfa7-49b7-8d16-cb74ebea2870',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.595675] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 1123.596091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.819961] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.819961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.820229] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.822273] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 938e860b-bfa7-49b7-8d16-cb74ebea2870 with status ACTIVE [ 1123.822495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.822625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.822691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.822902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.822989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.823195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.823294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.823358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.823511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.823587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.823763] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.823853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.823913] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.824063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.824137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.824220] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 is going to be updated. [ 1123.846302] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.846482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.846570] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.846811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.846948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.847138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.326544] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.828804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.829219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.829219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.829322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.829378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.829472] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be created. [ 1124.857125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.857360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.857360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.857549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.857719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.866825] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: UNINITIALIZED for 2s [ 1126.283490] env[65511]: INFO networking_nsxv3.common.synchronization [req-5362a63c-087f-41bf-915c-26c13518e907 req-e0ee0d06-eee2-4ee4-9324-04dd7244d667 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1126.283978] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGHEST for action security_group_members [ 1126.284310] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.284460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.284542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.284734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.284898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.285606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.285606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.285606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.285606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.285606] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.334538] env[65511]: INFO networking_nsxv3.common.synchronization [req-5362a63c-087f-41bf-915c-26c13518e907 req-e0ee0d06-eee2-4ee4-9324-04dd7244d667 tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with Priority: HIGHEST for action port [ 1126.335113] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with Priority: HIGHEST for action port [ 1126.335480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.335629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.335726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.336032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.336199] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97d0d4bc-9970-43a5-b84f-69a1e5b5bd59',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.788929] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.788929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.788929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.788929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.788929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.789315] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.789315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.789411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.789540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.789621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.789731] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be updated. [ 1126.838112] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.838309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.838425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.838694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.838848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.840360] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 with status ACTIVE [ 1126.840568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.840959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.841058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.841244] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.841345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.841410] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.841561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.841637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.841816] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.841910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.841968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.842134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.842186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.842276] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97d0d4bc-9970-43a5-b84f-69a1e5b5bd59 is going to be updated. [ 1126.853985] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: IN_PROGRESS for 2s [ 1126.871802] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.871802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.871802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.871802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.871988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.872233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97d0d4bc-9970-43a5-b84f-69a1e5b5bd59" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.877971] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1126.878345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.878584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.879209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.879209] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.879473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.879473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.879719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.879847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.879982] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.880156] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.383279] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.383707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.383707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.383816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.383908] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.384022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.384087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.384248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.384325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.384416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.384568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.384662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.384714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.384871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.384998] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.385127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.385181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.385336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.385416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.385512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.386660] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.889031] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fd11139-32d6-4786-a659-92cba5cecd13: rpc.has_security_group_logging(os_id): False [ 1127.909861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.910019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.910365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.910365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.910365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.910561] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.910678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.910769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.910858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.910948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.911200] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.911297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.911358] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.911506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.911584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.911765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.911857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.911916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.912249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.912296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.912387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be created. [ 1127.978819] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.979076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.979076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.979439] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.979519] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.993595] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1128.322173] env[65511]: INFO networking_nsxv3.common.synchronization [req-debb671d-b82e-4ba5-a4d3-eb345982ff4a req-bf3e8d44-3cc8-4a68-a80c-50e0a151056e tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 1128.322835] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGHEST for action security_group_members [ 1128.323327] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.323458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.323526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.323739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.323901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.324159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.324159] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.324272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.324301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.324405] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.466128] env[65511]: INFO networking_nsxv3.common.synchronization [None req-458c4826-e2be-4458-ba34-ef0e09bb5a0e tempest-AttachInterfacesTestJSON-399050037 tempest-AttachInterfacesTestJSON-399050037-project-member] Enqueued Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1128.466633] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 with Priority: HIGHEST for action security_group_members [ 1128.467158] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.467158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.467158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.467318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.467494] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.467654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.467654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.468045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.468045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.468045] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7e334b-4f27-4441-85ca-d5b22f8c8f07',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.826541] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.826709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.826762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.827026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.827081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.827302] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.829148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.829148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.829148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.829148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.829148] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce is going to be updated. [ 1128.857466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.857466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.857466] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.857744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.857744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.873649] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: IN_PROGRESS for 2s [ 1128.874391] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e in Status: SUCCESS [ 1128.874547] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e deletion is rescheduled due to dependency. [ 1128.874703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.972977] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.974798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.974883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.975271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.975427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.975681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.975824] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.975904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.976635] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.976768] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.976877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 is going to be updated. [ 1129.006803] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.006957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.007045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.007265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.007407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.017831] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: IN_PROGRESS for 2s [ 1130.006761] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1130.007090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.883766] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d2f242b-f07c-4860-9f69-67ee36089fce in Status: SUCCESS [ 1130.883953] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce deletion is rescheduled due to dependency. [ 1130.884086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.031199] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 in Status: SUCCESS [ 1131.032251] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7e334b-4f27-4441-85ca-d5b22f8c8f07 deletion is rescheduled due to dependency. [ 1131.032251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7e334b-4f27-4441-85ca-d5b22f8c8f07" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.304392] env[65511]: INFO networking_nsxv3.common.synchronization [None req-cb071b16-6aa3-4787-8dd7-05a5f24c5a35 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe with Priority: HIGHEST for action security_group_rules [ 1131.304392] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe with Priority: HIGHEST for action security_group_rules [ 1131.304392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.304392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.304392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.304392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.304392] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff7db9f-ca50-4ce4-aac2-571fc5907bbe',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.440987] env[65511]: INFO networking_nsxv3.common.synchronization [None req-ddc1b876-106a-4435-b52d-d9d5971d2d74 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe with Priority: HIGHEST for action security_group_rules [ 1131.441650] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe with Priority: HIGHEST for action security_group_rules [ 1131.442206] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.442324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.828593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.830924] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe already deleted. [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.830924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.830924] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff7db9f-ca50-4ce4-aac2-571fc5907bbe',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.352773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.353174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.353174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.353238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.353327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.353380] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff7db9f-ca50-4ce4-aac2-571fc5907bbe already deleted. [ 1132.353998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff7db9f-ca50-4ce4-aac2-571fc5907bbe" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.272499] env[65511]: INFO networking_nsxv3.common.synchronization [req-8fa69e32-0eba-4a56-a977-4ccd8383fb48 req-50f389b1-ffdc-4540-95e6-0a2b7712293f tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1136.273957] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1136.273957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.274185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.274907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.275737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.275737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.275737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.275737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.275737] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.275954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.275954] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.727957] env[65511]: INFO networking_nsxv3.common.synchronization [req-74bb2030-0fc3-4a9f-9847-719c9ce7c7ea req-3083dbc2-a879-46e4-8271-a79166bf6023 tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1136.728301] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGHEST for action security_group_members [ 1136.728772] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.729349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.729349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.729668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.729828] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.730247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.730247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.730247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.730357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.730357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.778688] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.778925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.778925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.779229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.779229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.779465] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.779626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.779738] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.779971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.780222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.780358] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1136.830867] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.830867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.830867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.830867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.830867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.840488] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1136.921148] env[65511]: INFO networking_nsxv3.common.synchronization [None req-242a715d-bfdf-4713-9c8a-7ba775971d80 tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1136.922188] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1136.924549] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.924549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.924549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.924549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.924549] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.045141] env[65511]: INFO networking_nsxv3.common.synchronization [None req-9584cb62-a6f9-495b-88e2-91643153e2d8 tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1137.045965] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1137.046373] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.046537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.233807] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.233807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.233807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.233807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.258599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.258953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.259089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.259733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.259733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.259733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.259733] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5850f55-9492-4366-816e-5251bfefc2bb is going to be updated. [ 1137.316734] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.317151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.317261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.317584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.317795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.330826] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: IN_PROGRESS for 2s [ 1137.457646] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.457906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.458062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.458339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.458427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.458791] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad already deleted. [ 1137.458996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.459318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.459647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.460280] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.991074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.991074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.991074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.991074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.991074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.991074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad already deleted. [ 1137.991074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.096027] env[65511]: INFO networking_nsxv3.common.synchronization [req-bc17a6ae-088b-4361-a183-8947e6013522 req-cae84b79-ba73-410f-87e5-3229d9926924 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1138.096027] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1138.096027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.096027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.096351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.096666] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.097282] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.097491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.097625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.097853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.098084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.098346] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.514865] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.515168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.515168] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.515399] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.515670] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.515819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.515962] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.516193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.516329] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.516539] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.516645] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.516760] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.516870] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.516982] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.517198] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.517348] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.537665] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.537829] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.537968] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.538162] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.538544] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-7f1116ec-4c67-42f9-8082-7e88d70dd73c taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.538737] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.538854] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.539194] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.539330] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1116ec-4c67-42f9-8082-7e88d70dd73c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.600516] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.600683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.600746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.600997] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.601103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.601290] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.601385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.601587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.601693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.601693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.601825] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1138.628046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.629051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.629051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.629051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.629051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.640620] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1138.849937] env[65511]: INFO networking_nsxv3.common.synchronization [req-7007db3a-cb94-47c3-8222-da0d3a7317e3 req-22e6d4ad-2676-4307-b13b-74030ea6f9fc tempest-DeleteServersTestJSON-1120948409 tempest-DeleteServersTestJSON-1120948409-project-member] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1138.850850] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGHEST for action security_group_members [ 1138.851223] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.851791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.851957] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.852073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.852135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.852287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.852370] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.852466] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.853877] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1138.854161] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1138.854161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.042463] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.042463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.042463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.042463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.042463] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.042709] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 7f1116ec-4c67-42f9-8082-7e88d70dd73c not found, creating... [ 1139.043391] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.043391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.043391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.043602] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.043819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.044131] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.044341] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.044523] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.044751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.044901] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.045634] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 7f1116ec-4c67-42f9-8082-7e88d70dd73c is going to be created. [ 1139.068023] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.068023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.068023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.068023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.068023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.068319] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.343346] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5850f55-9492-4366-816e-5251bfefc2bb in Status: SUCCESS [ 1139.343544] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5850f55-9492-4366-816e-5251bfefc2bb deletion is rescheduled due to dependency. [ 1139.343706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.355587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.355587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.355587] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.355776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.355875] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.356657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.356789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.356858] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.357062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.357200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.357249] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be updated. [ 1139.388349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.388584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.388663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.388825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.388967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.399656] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: IN_PROGRESS for 2s [ 1139.777239] env[65511]: INFO networking_nsxv3.common.synchronization [req-bc17a6ae-088b-4361-a183-8947e6013522 req-e345a73d-0f48-4feb-b350-3d1a75bac58c service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 1139.777239] env[65511]: INFO networking_nsxv3.common.synchronization [req-bc17a6ae-088b-4361-a183-8947e6013522 req-e345a73d-0f48-4feb-b350-3d1a75bac58c service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1139.777239] env[65511]: INFO networking_nsxv3.common.synchronization [req-bc17a6ae-088b-4361-a183-8947e6013522 req-e345a73d-0f48-4feb-b350-3d1a75bac58c service nova] Enqueued Resource ID: 7f1116ec-4c67-42f9-8082-7e88d70dd73c with Priority: HIGHEST for action port [ 1139.779035] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 1139.779221] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1139.780176] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1116ec-4c67-42f9-8082-7e88d70dd73c with Priority: HIGHEST for action port [ 1139.781286] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.781286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.781286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.781286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.781286] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.781987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.781987] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.781987] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1116ec-4c67-42f9-8082-7e88d70dd73c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.782145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.782145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.782845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.782845] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1116ec-4c67-42f9-8082-7e88d70dd73c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.283829] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.283829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.286525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f1116ec-4c67-42f9-8082-7e88d70dd73c with status ACTIVE [ 1140.286525] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.286767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.286767] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.286960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.287046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.287228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.287336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.287422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.287541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.287620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.288026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.288026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.288026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.288153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.288181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.288447] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f1116ec-4c67-42f9-8082-7e88d70dd73c is going to be updated. [ 1140.317976] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.318231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.318231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.318414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.318659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.318761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1116ec-4c67-42f9-8082-7e88d70dd73c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.651238] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1140.651415] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c deletion is rescheduled due to dependency. [ 1140.651525] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.651687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.651912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.652106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.652239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.652300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.652465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.652543] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.652635] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.077976] env[65511]: INFO networking_nsxv3.common.synchronization [req-0c899042-cdb6-4970-aa70-9dc3d746c51a req-8bd5b2b3-6087-49b1-aed9-75f5949a8759 tempest-ServerActionsV293TestJSON-25790149 tempest-ServerActionsV293TestJSON-25790149-project-member] Enqueued Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1141.078745] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd325407-ae36-43a1-abed-91fd5cc630ba with Priority: HIGHEST for action security_group_members [ 1141.079102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd325407-ae36-43a1-abed-91fd5cc630ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.079232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.079360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.079585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.079769] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.079912] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.079974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.080532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.080632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.080730] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd325407-ae36-43a1-abed-91fd5cc630ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.155386] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.412874] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 in Status: SUCCESS [ 1141.412874] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 deletion is rescheduled due to dependency. [ 1141.412874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.585303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.585603] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.585726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.586032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.586149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.586365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.586486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.586562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.586732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.586823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.586913] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba is going to be updated. [ 1141.624208] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.624347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.624413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.624632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.624775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.634041] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: IN_PROGRESS for 2s [ 1141.657720] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.160457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.160784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.160784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.160961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.161019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.161110] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1142.197285] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.197448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.197487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.197726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.198485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.208381] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1142.885105] env[65511]: INFO networking_nsxv3.common.synchronization [req-3e1fb140-cfc5-4597-962d-a5b8dfff7b60 req-1b0edda5-5a6b-459f-a980-fe6a02f20825 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1142.885700] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1142.888230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.888448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.888448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.891274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.891274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.891274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.891274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.891274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.891274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.891274] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.396564] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.396863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.396863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.397116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.397217] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.397476] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.397610] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.397710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.397876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.397992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.398104] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1143.411953] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.412873] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.413021] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.413270] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.413540] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.413690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.413804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.414079] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.414184] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.414401] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.414513] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.414608] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.414719] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.414801] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.414935] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.415035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.432709] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.432870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.432936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.433178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.433325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.435477] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.435659] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.435830] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.435942] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.436260] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.436425] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.436539] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.436853] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.436990] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.448023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1143.672883] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd325407-ae36-43a1-abed-91fd5cc630ba in Status: SUCCESS [ 1143.673131] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd325407-ae36-43a1-abed-91fd5cc630ba deletion is rescheduled due to dependency. [ 1143.673382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd325407-ae36-43a1-abed-91fd5cc630ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.742688] env[65511]: INFO networking_nsxv3.common.synchronization [req-b0a0ba37-9934-4295-9001-cd66ba66a932 req-e841a016-49c0-4d93-b611-7d0422e6cfdf tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1143.743282] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1143.743626] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.743753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.743817] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.744040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.744198] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.744296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.744437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.744602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.744694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.744826] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.940744] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.941303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.941485] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.942250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.942250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.942250] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 not found, creating... [ 1143.942617] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.942765] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.942890] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.943122] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.943261] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.943557] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.943710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.943820] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.944033] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.944167] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.944341] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 is going to be created. [ 1143.971800] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.971800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.971800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.971800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.971800] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.973325] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.224263] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1144.224498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.224683] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.224918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.225139] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.225259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.225331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.225510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.225595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.225685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.225779] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.246720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.246881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.247100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.247201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.247283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.247489] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.247582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.247638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.247791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.247868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.247957] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1144.292155] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.292323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.292397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.292688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.292848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.302934] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1144.722504] env[65511]: INFO networking_nsxv3.common.synchronization [req-3e1fb140-cfc5-4597-962d-a5b8dfff7b60 req-98fe49fd-0cff-4072-82c4-24ab76e65875 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1144.722778] env[65511]: INFO networking_nsxv3.common.synchronization [req-3e1fb140-cfc5-4597-962d-a5b8dfff7b60 req-98fe49fd-0cff-4072-82c4-24ab76e65875 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1144.722843] env[65511]: INFO networking_nsxv3.common.synchronization [req-3e1fb140-cfc5-4597-962d-a5b8dfff7b60 req-98fe49fd-0cff-4072-82c4-24ab76e65875 service nova] Enqueued Resource ID: bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 with Priority: HIGHEST for action port [ 1144.725020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1144.725755] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1144.725755] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 with Priority: HIGHEST for action port [ 1144.725926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.725994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.726043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.726242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.726314] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.727532] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.727532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.727532] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.727747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.727747] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.727864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.727948] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.729342] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.230397] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.230633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.230835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 with status ACTIVE [ 1145.231048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.231167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.231234] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.231448] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.231537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.231709] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.231819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.231909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.232126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.232199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.232394] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.232501] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.232557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.232682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.232743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.232835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1 is going to be updated. [ 1145.233925] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0f00d64-0787-45ef-b61c-8c6c22be615c: rpc.has_security_group_logging(os_id): False [ 1145.251955] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.252160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.252209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.252415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.252502] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.252811] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.252964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.252964] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.253156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.253236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.253535] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1145.256810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.256938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.256993] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.257190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.257319] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.257503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbe2cbaa-da7a-4181-af2a-bdc3d2b835e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.337028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.337287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.337373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.337616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.337799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.370286] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1145.462969] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1145.463153] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1145.463281] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.463551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.463804] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.464346] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.464346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.464346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.464498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.464563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.464625] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.600750] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1145.601652] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1145.602248] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1145.602298] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1145.602557] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.602676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.602741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.602940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.603322] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.603322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.603322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.603564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.603564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.603650] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.604463] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27fc843-2f4e-418c-9cff-a58816796bee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.604695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.604695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.604874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.605179] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.605179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.605179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.605420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.605420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.605420] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.653934] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1145.654639] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1145.654639] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_rules [ 1145.654639] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1145.654639] env[65511]: INFO networking_nsxv3.common.synchronization [req-d24ed918-c4e1-40f3-b555-79562944f99e req-9fa0cc41-2c03-4cd7-856c-f65f78284e65 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1145.655527] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1145.655527] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_rules [ 1145.655527] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1145.655527] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1145.655696] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1145.655868] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.656653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.656653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.656653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.656653] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.657632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e27fc843-2f4e-418c-9cff-a58816796bee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.658411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.658411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.658411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.658411] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.659561] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-938e860b-bfa7-49b7-8d16-cb74ebea2870 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.659561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.659561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.659561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.659561] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938e860b-bfa7-49b7-8d16-cb74ebea2870',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.661125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.661125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.661125] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27fc843-2f4e-418c-9cff-a58816796bee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.661125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.966611] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.107400] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.108507] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.162116] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 938e860b-bfa7-49b7-8d16-cb74ebea2870 with status ACTIVE [ 1146.166236] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.166236] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.166236] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.166236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.166236] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 is going to be updated. [ 1146.166909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.166909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.166909] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27fc843-2f4e-418c-9cff-a58816796bee taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.166909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.186173] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.186367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.186409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.186675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.186827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.187021] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.317561] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1146.317561] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 deletion is rescheduled due to dependency. [ 1146.317561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.464273] env[65511]: INFO networking_nsxv3.common.synchronization [req-26a32229-92bc-4442-8b0d-09e3688fe2b6 req-91e8b4fa-cbb7-48a3-a533-f1633d1d41f5 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1146.464510] env[65511]: INFO networking_nsxv3.common.synchronization [req-26a32229-92bc-4442-8b0d-09e3688fe2b6 req-91e8b4fa-cbb7-48a3-a533-f1633d1d41f5 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1146.465093] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1146.465231] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27fc843-2f4e-418c-9cff-a58816796bee with Priority: HIGHEST for action security_group_members [ 1146.465498] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.465600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.465801] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e27fc843-2f4e-418c-9cff-a58816796bee taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.466052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.469686] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.505722] env[65511]: INFO networking_nsxv3.common.synchronization [req-26a32229-92bc-4442-8b0d-09e3688fe2b6 req-91e8b4fa-cbb7-48a3-a533-f1633d1d41f5 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1146.505897] env[65511]: INFO networking_nsxv3.common.synchronization [req-26a32229-92bc-4442-8b0d-09e3688fe2b6 req-91e8b4fa-cbb7-48a3-a533-f1633d1d41f5 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1146.506052] env[65511]: INFO networking_nsxv3.common.synchronization [req-26a32229-92bc-4442-8b0d-09e3688fe2b6 req-91e8b4fa-cbb7-48a3-a533-f1633d1d41f5 tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1146.506543] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_rules [ 1146.506743] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1146.506871] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 with Priority: HIGHEST for action port [ 1146.507471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.507576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.507786] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.507871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.508064] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-938e860b-bfa7-49b7-8d16-cb74ebea2870 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.508166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.508227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.508429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.508498] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938e860b-bfa7-49b7-8d16-cb74ebea2870',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.611053] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.612219] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.972457] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.972828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.972828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.972892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.973062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.973192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1147.004569] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.004807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.004807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.005161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.005844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.012248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 938e860b-bfa7-49b7-8d16-cb74ebea2870 with status ACTIVE [ 1147.012516] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.012696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.012764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.013074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.013200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.013735] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.013735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.013735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.013901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.013981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.014230] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.014372] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.014416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.014554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.014634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.014724] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 938e860b-bfa7-49b7-8d16-cb74ebea2870 is going to be updated. [ 1147.017185] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1147.049036] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.049036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.049276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.049481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.050139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.050139] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938e860b-bfa7-49b7-8d16-cb74ebea2870" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.115276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.115276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.115276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.115689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.115689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.115689] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1147.117315] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.117315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.117493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.117574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.117732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.117778] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27fc843-2f4e-418c-9cff-a58816796bee is going to be created. [ 1147.163772] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.163954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.164068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.164312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.164489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.173192] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.175700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.175700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.175700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.175700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.175700] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27fc843-2f4e-418c-9cff-a58816796bee in Status: UNINITIALIZED for 2s [ 1147.188206] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1147.384180] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1147.384777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.030288] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1149.030716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.030759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.031044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.031294] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.031443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.031522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.031715] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.031820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.031920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.032941] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.188367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e27fc843-2f4e-418c-9cff-a58816796bee in Status: SUCCESS [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.188367] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.188367] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.188367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.198450] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1149.198450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.198450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.198450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.198450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.198450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.198450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.199094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.199094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.199094] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.537060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.537060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.537060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.540527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.540527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.540527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.540527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.541063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.541063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.541138] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.693195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.693379] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.693441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.693690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.693751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.693931] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.694035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.694089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.694630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.694630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.694630] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27fc843-2f4e-418c-9cff-a58816796bee is going to be deleted. [ 1149.701494] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.726843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.726843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.726843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.727206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.727206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.727360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.727395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.727524] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.728671] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.728671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.728671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.728671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.728671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.728671] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.043907] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 751af4d7-7958-43dc-a40b-b5e3493c4166: rpc.has_security_group_logging(os_id): False [ 1150.064949] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.065345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.065345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.065674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.065674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.067132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.067132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.067132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.067798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.068475] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.068939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.069037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.069344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.069842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.071146] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1150.149940] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.150150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.150261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.150479] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.152215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.180074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1150.203801] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.233844] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.233844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.234047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.234639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.234639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.234639] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.234949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.234949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.235740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.235740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.235841] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27fc843-2f4e-418c-9cff-a58816796bee already deleted. [ 1150.235841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.235985] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.238271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.238475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.238686] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.238896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.238970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.239163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.239613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.239682] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.589179] env[65511]: INFO networking_nsxv3.common.synchronization [req-a85d0c74-39c7-46c4-b7fa-6ffe79df058c req-886fc520-a756-4303-8080-5a2b735e2823 tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1150.589179] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1150.589179] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.589179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.589179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.590199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.591526] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.591526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.591526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.591526] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.592084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.592352] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.707048] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.707334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.707476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.709788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.709788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.709788] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1150.739971] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e27fc843-2f4e-418c-9cff-a58816796bee',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.742872] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.743153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.743204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.743499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.743782] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.745413] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.745578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.745681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.745930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.746073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.746352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.746523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.746638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.746887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.747039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.747184] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e27fc843-2f4e-418c-9cff-a58816796bee already deleted. [ 1150.747323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.758598] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1151.069144] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.069468] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.069468] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.069761] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.070050] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.070222] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.070340] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.070565] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.070738] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.071063] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.071191] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.071299] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.071407] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.071517] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.071625] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.071777] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.093232] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.093402] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.093757] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.093757] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-394" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.094044] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-afb6f630-07ea-4db1-9f99-88732d15f863 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.094222] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.094350] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.094653] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.094788] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb6f630-07ea-4db1-9f99-88732d15f863',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.095751] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.095870] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.095938] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.096138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.096206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.096380] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.096472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.096531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.096753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.096828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.096869] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad already deleted. [ 1151.096948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.242276] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e27fc843-2f4e-418c-9cff-a58816796bee: rpc.has_security_group_logging(os_id): False [ 1151.263031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.263207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.263247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.263538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.263808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.263986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.264164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.264264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.264517] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.264629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.264793] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27fc843-2f4e-418c-9cff-a58816796bee is going to be created. [ 1151.288787] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee], does not exist path=[/infra/domains/default/groups/e27fc843-2f4e-418c-9cff-a58816796bee]."\n}' [ 1151.288970] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27fc843-2f4e-418c-9cff-a58816796bee failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee [ 1151.289073] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1151.357710] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.357816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.357816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.358017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.361030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.361030] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.361030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.361030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.361030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.361304] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.361453] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.361761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.361761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.361950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.362090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.362511] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e27fc843-2f4e-418c-9cff-a58816796bee is going to be created. [ 1151.382222] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee], does not exist path=[/infra/domains/default/groups/e27fc843-2f4e-418c-9cff-a58816796bee]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee [ 1151.382378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e27fc843-2f4e-418c-9cff-a58816796bee" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.382618] env[65511]: Traceback (most recent call last): [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1151.382672] env[65511]: return func(*args, **kwargs) [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1151.382672] env[65511]: res.raise_for_status() [ 1151.382672] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1151.382672] env[65511]: raise HTTPError(http_error_msg, response=self) [ 1151.382672] env[65511]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee [ 1151.382672] env[65511]: During handling of the above exception, another exception occurred: [ 1151.382672] env[65511]: Traceback (most recent call last): [ 1151.382672] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1151.382672] env[65511]: listener.cb(fileno) [ 1151.382672] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1151.382672] env[65511]: result = function(*args, **kwargs) [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1151.382672] env[65511]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1151.382672] env[65511]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1151.382672] env[65511]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1151.382672] env[65511]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1151.382672] env[65511]: res.raise_for_status() [ 1151.382672] env[65511]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1151.382672] env[65511]: raise HTTPError(http_error_msg, response=self) [ 1151.382672] env[65511]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e27fc843-2f4e-418c-9cff-a58816796bee [ 1151.383460] env[65511]: Removing descriptor: 61 [ 1151.598211] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.598444] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.598565] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.598993] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.599206] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.599364] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port afb6f630-07ea-4db1-9f99-88732d15f863 not found, creating... [ 1151.599666] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.599858] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.599986] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.600261] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.600398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.600708] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.600880] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.600995] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.601267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.601414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.601554] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: afb6f630-07ea-4db1-9f99-88732d15f863 is going to be created. [ 1151.624794] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.625252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.625386] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.625786] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.626198] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.626559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.248910] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1152.249248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.584630] env[65511]: INFO networking_nsxv3.common.synchronization [req-a85d0c74-39c7-46c4-b7fa-6ffe79df058c req-ec8ac967-6639-4b42-8599-5a3469c0596b service nova] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1152.584809] env[65511]: INFO networking_nsxv3.common.synchronization [req-a85d0c74-39c7-46c4-b7fa-6ffe79df058c req-ec8ac967-6639-4b42-8599-5a3469c0596b service nova] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1152.585057] env[65511]: INFO networking_nsxv3.common.synchronization [req-a85d0c74-39c7-46c4-b7fa-6ffe79df058c req-ec8ac967-6639-4b42-8599-5a3469c0596b service nova] Enqueued Resource ID: afb6f630-07ea-4db1-9f99-88732d15f863 with Priority: HIGHEST for action port [ 1152.585470] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_rules [ 1152.585612] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1152.585713] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb6f630-07ea-4db1-9f99-88732d15f863 with Priority: HIGHEST for action port [ 1152.586009] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.586455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.586592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.586851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.586972] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.588171] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.588494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.588616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.588887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.589092] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.589249] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.589338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.589533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.589864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.590011] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.591898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb6f630-07ea-4db1-9f99-88732d15f863 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.592066] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.592204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.592376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.592549] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb6f630-07ea-4db1-9f99-88732d15f863',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.738594] env[65511]: INFO networking_nsxv3.common.synchronization [req-36f634aa-61b7-4b9b-8cbd-952e24aa89eb req-fe31362e-712e-4ade-9d11-2d987f5008d3 tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 1152.739652] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 1152.739652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.739652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.739652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.739908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.740015] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.740392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.740462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.740618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.741189] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.741189] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.770560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1152.773591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.773918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.774371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.774463] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.774643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.774796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.775044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.775353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.775497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.776214] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.777222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.777406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.777652] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.778874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.778874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.778874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.778874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.778874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.094257] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.095352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.095499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.095819] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afb6f630-07ea-4db1-9f99-88732d15f863 with status ACTIVE [ 1153.095988] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.096099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.096191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.096432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.096474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.096675] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.096794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.096859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.097036] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.097117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.097298] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.097390] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.097450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.097592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.097665] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.097748] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afb6f630-07ea-4db1-9f99-88732d15f863 is going to be updated. [ 1153.123132] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.123132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.123132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.123132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.123528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.123528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb6f630-07ea-4db1-9f99-88732d15f863" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.243436] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.279837] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.280230] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.280737] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.346579] env[65511]: INFO networking_nsxv3.common.synchronization [req-b5d888b8-aebb-4b3c-9ef9-0b8c6bac2aa1 req-62523332-7db9-45ed-affd-034c2884927c tempest-ServerRescueTestJSONUnderV235-1669723555 tempest-ServerRescueTestJSONUnderV235-1669723555-project-member] Enqueued Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1153.347213] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd11139-32d6-4786-a659-92cba5cecd13 with Priority: HIGHEST for action security_group_members [ 1153.347594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.347772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.597033] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.746730] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.784075] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.099554] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.099838] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.099955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.100206] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.100303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.100414] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad is going to be created. [ 1154.126422] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.126901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.126901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.127075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.127269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.138700] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: UNINITIALIZED for 2s [ 1154.251708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.253505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.253505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.255473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.255473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.255473] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be updated. [ 1154.287775] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.288058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.288058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.288703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.288703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.288703] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1154.340977] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.341140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.344049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.344049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.344049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.352888] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.353069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.353134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.353343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.353491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.355559] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 1154.369371] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1156.151374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: SUCCESS [ 1156.151723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.151842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.152027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.152248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.152384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.152453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.152617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.152700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.152785] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.152874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.366932] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 1156.367188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.379392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1156.379630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.379864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.380201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.380419] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.380540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.380606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.380830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.380956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.381357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.658970] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.836460] env[65511]: INFO networking_nsxv3.common.synchronization [req-1372f84b-6e1a-46d3-b49c-528e51db3f9f req-e2a3a863-d1d1-4afb-a3c3-e0700ef775ee tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1156.837314] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1156.837735] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.837901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.837988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.838418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.838519] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.838651] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.838859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.838963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.840094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.840094] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.883405] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.883571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.883571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.883790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.905678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.906052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.906174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.906174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.906338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.906406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.906506] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1156.934568] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.934568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.934568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.936185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.936397] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.947098] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1157.161121] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e10b5b1-3407-4c5d-90d3-1dec0da978ad: rpc.has_security_group_logging(os_id): False [ 1157.179843] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.180061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.180133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.180289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.180378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.180629] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.180728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.180780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.180941] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.181025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.181113] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad is going to be created. [ 1157.252923] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.253344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.253344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.253481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.253542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.269465] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: IN_PROGRESS for 2s [ 1157.342084] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.758040] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.758262] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.758376] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.758678] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.758998] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.759396] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.759520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.759900] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.760630] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.760630] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.760630] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.760630] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.760630] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.760827] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.760858] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.761065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.782279] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.782279] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.782279] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.782279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-604" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.782279] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-f44ddf3f-defd-499a-9400-39c7d9b5fd22 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.782279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.782279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.782645] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.782645] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f44ddf3f-defd-499a-9400-39c7d9b5fd22',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.845233] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.288028] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.288028] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port f44ddf3f-defd-499a-9400-39c7d9b5fd22 not found, creating... [ 1158.288028] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.288028] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.290389] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.290389] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.293684] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.293684] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.293684] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.293684] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: f44ddf3f-defd-499a-9400-39c7d9b5fd22 is going to be created. [ 1158.314465] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.314697] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.314826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.315211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.315605] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.315901] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.348247] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.348505] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.348671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.348975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.349100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.349217] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1158.387493] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.387745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.387745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.387942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.388120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.399627] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1158.958221] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1158.958557] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 deletion is rescheduled due to dependency. [ 1158.958793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.959087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.959664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.959904] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.960070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.960236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.960393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.960583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.960699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.960926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fd11139-32d6-4786-a659-92cba5cecd13 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.961047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.961156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.961336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.961512] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.961674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.961758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.961935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.962018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.962151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.962263] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.963210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.963549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.964021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.964151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.966688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.966688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.966688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.966688] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.072163] env[65511]: INFO networking_nsxv3.common.synchronization [req-1372f84b-6e1a-46d3-b49c-528e51db3f9f req-15eff906-9317-4dd3-9187-51f730d31c2e service nova] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 1159.072163] env[65511]: INFO networking_nsxv3.common.synchronization [req-1372f84b-6e1a-46d3-b49c-528e51db3f9f req-15eff906-9317-4dd3-9187-51f730d31c2e service nova] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1159.072163] env[65511]: INFO networking_nsxv3.common.synchronization [req-1372f84b-6e1a-46d3-b49c-528e51db3f9f req-15eff906-9317-4dd3-9187-51f730d31c2e service nova] Enqueued Resource ID: f44ddf3f-defd-499a-9400-39c7d9b5fd22 with Priority: HIGHEST for action port [ 1159.072163] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_rules [ 1159.072163] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1159.072425] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44ddf3f-defd-499a-9400-39c7d9b5fd22 with Priority: HIGHEST for action port [ 1159.072826] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.073044] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.073152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.073421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.073557] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.075195] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.075351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.075695] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f44ddf3f-defd-499a-9400-39c7d9b5fd22 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.075890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.075998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.076263] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.076391] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f44ddf3f-defd-499a-9400-39c7d9b5fd22',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.273224] env[65511]: INFO networking_nsxv3.common.synchronization [None req-899317a9-ebb2-4645-bf53-0944deca5a38 None None] Enqueued Resource ID: 4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8 with Priority: HIGHEST for action port [ 1159.273830] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8 with Priority: HIGHEST for action port [ 1159.274680] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.274815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.274871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.275197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.275256] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.290575] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: SUCCESS [ 1159.293133] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.470025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.470025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.470025] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.470025] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1159.470025] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fd11139-32d6-4786-a659-92cba5cecd13: rpc.has_security_group_logging(os_id): False [ 1159.499254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.499420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.499488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.499674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.499766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.499964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.500179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.500179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.500944] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.500944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.503155] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.503155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.503155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.503155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.503155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.503155] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be updated. [ 1159.513788] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.513788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.513788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.514130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.514130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.523777] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1159.576029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.576029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.578528] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f44ddf3f-defd-499a-9400-39c7d9b5fd22 with status ACTIVE [ 1159.578730] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.578951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.579045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.579339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.579474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.579696] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.579928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.580260] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.580456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.580622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.580783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.580885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.581019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.581144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.581214] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.581306] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f44ddf3f-defd-499a-9400-39c7d9b5fd22 is going to be updated. [ 1159.607634] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.607907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.607907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.608468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.608468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.622882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.623165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.623232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.623518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.623736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.623986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f44ddf3f-defd-499a-9400-39c7d9b5fd22" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.625999] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: IN_PROGRESS for 2s [ 1159.788033] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8 [ 1159.788033] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.788033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.788033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.788033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.788321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.788321] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8 already deleted. [ 1159.788321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d08e035-78c8-4ca2-a6ab-c6ad2aa96ba8" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.410609] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1160.410959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.410959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.411243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.411789] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.411789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.411789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.411988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.411988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.411988] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.915683] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.421632] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.547470] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1161.547470] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 deletion is rescheduled due to dependency. [ 1161.547642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.650258] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fd11139-32d6-4786-a659-92cba5cecd13 in Status: SUCCESS [ 1161.650572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.650852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.651103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.651196] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fd11139-32d6-4786-a659-92cba5cecd13',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.871488] env[65511]: INFO networking_nsxv3.common.synchronization [None req-68fb46c4-6bbf-488e-afa7-39822bac8960 None None] Enqueued Resource ID: 04cca6c4-e881-4a86-a781-a8a49f0c4822 with Priority: HIGHEST for action port [ 1161.872052] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04cca6c4-e881-4a86-a781-a8a49f0c4822 with Priority: HIGHEST for action port [ 1161.872370] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-04cca6c4-e881-4a86-a781-a8a49f0c4822 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.872482] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04cca6c4-e881-4a86-a781-a8a49f0c4822" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.872542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04cca6c4-e881-4a86-a781-a8a49f0c4822" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.872792] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04cca6c4-e881-4a86-a781-a8a49f0c4822" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.872874] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04cca6c4-e881-4a86-a781-a8a49f0c4822',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.926412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.926412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.926412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.926412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.926412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.926412] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1161.965305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.965659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.965659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.967246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.967246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.988379] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1162.176392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.176600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.176600] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.176856] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.176977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.177113] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fd11139-32d6-4786-a659-92cba5cecd13 is going to be deleted. [ 1162.237808] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.238067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.238157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.238446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.238586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.238778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fd11139-32d6-4786-a659-92cba5cecd13" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.376494] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04cca6c4-e881-4a86-a781-a8a49f0c4822 [ 1162.377087] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.377704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.377868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.378489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.378489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.378489] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04cca6c4-e881-4a86-a781-a8a49f0c4822 already deleted. [ 1162.378643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04cca6c4-e881-4a86-a781-a8a49f0c4822" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.507180] env[65511]: INFO networking_nsxv3.common.synchronization [req-d34f1b2d-033e-46ee-85db-b01c9c33d4e4 req-b4e77863-94b9-4bf7-a0d3-2f751c07780f tempest-ServerRescueNegativeTestJSON-591255384 tempest-ServerRescueNegativeTestJSON-591255384-project-member] Enqueued Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 1163.508362] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c with Priority: HIGHEST for action security_group_members [ 1163.508362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.508510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.508542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.508791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.509122] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.509122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.509267] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.509408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.509521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.509643] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0614801-abc8-4a0a-a4f8-e0e682a1e02c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.651478] env[65511]: INFO networking_nsxv3.common.synchronization [None req-fac20595-80d4-4f1a-b307-3dd800ed7198 None None] Enqueued Resource ID: 0c72f407-b235-4edc-b103-560e1fb59120 with Priority: HIGHEST for action port [ 1163.652070] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c72f407-b235-4edc-b103-560e1fb59120 with Priority: HIGHEST for action port [ 1163.652779] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c72f407-b235-4edc-b103-560e1fb59120 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.652932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c72f407-b235-4edc-b103-560e1fb59120" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.653068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c72f407-b235-4edc-b103-560e1fb59120" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.653414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c72f407-b235-4edc-b103-560e1fb59120" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.653505] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c72f407-b235-4edc-b103-560e1fb59120',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.818380] env[65511]: INFO networking_nsxv3.common.synchronization [req-76b47565-87b9-4483-9119-0cf245b40693 req-6ebae41c-c38f-4025-bf9b-44f3697a80d0 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 1163.818681] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGHEST for action security_group_members [ 1163.819375] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.819688] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.819956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.820340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.822385] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.822385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.822385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.822385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.822385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.822385] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.999824] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1164.000121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.000881] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.000950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.001462] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.001462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.001462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.001462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.001656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.001656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.001711] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.012478] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.012629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.012690] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.013016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.039810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.040109] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.040313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.040392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.040825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.040917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.041038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c is going to be updated. [ 1164.079934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.079934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.079934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.079934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.079934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.091471] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: IN_PROGRESS for 2s [ 1164.160560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c72f407-b235-4edc-b103-560e1fb59120 [ 1164.160560] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.160560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.160560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.160560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.160560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.160560] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c72f407-b235-4edc-b103-560e1fb59120 already deleted. [ 1164.160560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c72f407-b235-4edc-b103-560e1fb59120" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.326341] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.326560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.326675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.327026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.352373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.353610] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.353706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.353807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.354032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.354209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.354267] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be updated. [ 1164.387022] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.387204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.387264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.387970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.387970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.398279] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: IN_PROGRESS for 2s [ 1164.506326] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.009283] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 323c831e-3e57-4559-b403-13f13a8cf909: rpc.has_security_group_logging(os_id): False [ 1165.032029] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.032250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.032742] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.033063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.054597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.054942] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.055083] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.055158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.055376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.055454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.055552] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1165.120637] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.120637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.120637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.120637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.120854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.137217] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1166.094823] env[65511]: INFO networking_nsxv3.common.synchronization [None req-a4795169-0c76-4697-9247-5b36ae1ca08a None None] Enqueued Resource ID: d0b81f59-2a01-4f61-b179-db0d679ff60c with Priority: HIGHEST for action port [ 1166.098475] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b81f59-2a01-4f61-b179-db0d679ff60c with Priority: HIGHEST for action port [ 1166.098990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b81f59-2a01-4f61-b179-db0d679ff60c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.098990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b81f59-2a01-4f61-b179-db0d679ff60c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.098990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b81f59-2a01-4f61-b179-db0d679ff60c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.100059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b81f59-2a01-4f61-b179-db0d679ff60c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.100059] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b81f59-2a01-4f61-b179-db0d679ff60c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.109393] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c in Status: SUCCESS [ 1166.109393] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0614801-abc8-4a0a-a4f8-e0e682a1e02c deletion is rescheduled due to dependency. [ 1166.109393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0614801-abc8-4a0a-a4f8-e0e682a1e02c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.411879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22614963-faca-462c-8364-ac7ae98c2969 in Status: SUCCESS [ 1166.411879] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22614963-faca-462c-8364-ac7ae98c2969 deletion is rescheduled due to dependency. [ 1166.411879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.603650] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b81f59-2a01-4f61-b179-db0d679ff60c [ 1166.603914] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.604063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.604134] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.604373] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.604443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.604924] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b81f59-2a01-4f61-b179-db0d679ff60c already deleted. [ 1166.604924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b81f59-2a01-4f61-b179-db0d679ff60c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.154037] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1167.154515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.027783] env[65511]: INFO networking_nsxv3.common.synchronization [req-54cf8815-4ea4-498d-bb9e-93de5dca4118 req-2ed592ca-122d-40e6-aea4-25f8ad680dcc tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1168.027783] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1168.027783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.027783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.027783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.027783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.027783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.027783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.028270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.028270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.028270] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.430140] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.430419] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.430419] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.430647] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.430889] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.431060] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.431154] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.431357] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.431491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.431686] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.431787] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.431884] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.431989] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.432151] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.432204] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.432322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.453023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.453023] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.453023] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.453023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.453023] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.453023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.453023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.453023] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.453023] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd706dd-a1c2-4db1-b7b5-705a43afcf12',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.531386] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.531544] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.531617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.531832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.554736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.555025] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.555163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.555246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.555481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.555572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.555668] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1168.580220] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.580354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.580395] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.580927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.580927] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.590772] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1168.957050] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.957050] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 not found, creating... [ 1168.957050] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.957050] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.957614] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.957850] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.958222] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.958471] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.958629] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958907] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.959133] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.959331] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 is going to be created. [ 1168.979353] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.979559] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.979677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.980018] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.980274] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.980497] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.709121] env[65511]: INFO networking_nsxv3.common.synchronization [req-54cf8815-4ea4-498d-bb9e-93de5dca4118 req-5dc08cfd-63cc-47ef-82a5-c1b960996a55 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1169.709496] env[65511]: INFO networking_nsxv3.common.synchronization [req-54cf8815-4ea4-498d-bb9e-93de5dca4118 req-5dc08cfd-63cc-47ef-82a5-c1b960996a55 service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1169.709496] env[65511]: INFO networking_nsxv3.common.synchronization [req-54cf8815-4ea4-498d-bb9e-93de5dca4118 req-5dc08cfd-63cc-47ef-82a5-c1b960996a55 service nova] Enqueued Resource ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with Priority: HIGHEST for action port [ 1169.709985] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1169.710146] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1169.710293] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with Priority: HIGHEST for action port [ 1169.710581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.710705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.710769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.710963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.711058] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.711967] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.712077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.712274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.712376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.712438] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.712614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.712691] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd706dd-a1c2-4db1-b7b5-705a43afcf12',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.215364] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with status ACTIVE [ 1170.215640] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.215884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.215884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.216106] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.216160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.216327] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.216412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.216483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.216663] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.216722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.216863] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.216971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.217033] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.217172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.217243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.217327] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 is going to be updated. [ 1170.218722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.218880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.241397] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.241645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.241701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.241926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.242054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.242905] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.600937] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1170.601131] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 deletion is rescheduled due to dependency. [ 1170.601193] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.601355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.601567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.601755] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.601879] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.601940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.602075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.602251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.602251] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.104500] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.334579] env[65511]: INFO networking_nsxv3.common.synchronization [req-56d62643-8350-43e9-9fe8-0da7ef3704bf req-d527148d-b133-47c5-84c6-d0e2cb1bb8b3 tempest-InstanceActionsTestJSON-682110489 tempest-InstanceActionsTestJSON-682110489-project-member] Enqueued Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1171.335220] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1171.335535] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.335671] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.335741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.336008] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.336491] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.336608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.336676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.336880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.336994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.337134] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.606996] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.640750] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.641085] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-455" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.641085] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-455" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.641595] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-455" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.641738] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.641925] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.642283] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.642540] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.642687] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.642883] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.642985] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.643099] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.643205] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.643307] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.643403] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.643547] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.661911] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.662110] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.662230] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.662398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-455" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.662699] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-93800e05-dd83-49a7-8eb0-1b49f7c283b3 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.662862] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.662978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.663304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.663439] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93800e05-dd83-49a7-8eb0-1b49f7c283b3',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.840077] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.840268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.840378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.840607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.840643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.840857] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.841037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.841037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.841276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.841313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.841443] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 654897c8-ca85-454b-9298-fd7f00082aef already deleted. [ 1171.841527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.110402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.111616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.114705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.114705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.114705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.114705] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1172.145722] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.145722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.145722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.145722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.145722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.152982] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1172.166488] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.169019] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 93800e05-dd83-49a7-8eb0-1b49f7c283b3 not found, creating... [ 1172.169019] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.169019] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.169487] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.169859] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.170164] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.170381] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.170677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.171121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.171388] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 93800e05-dd83-49a7-8eb0-1b49f7c283b3 is going to be created. [ 1172.196731] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.196998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.197118] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.197461] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.197695] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.197932] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.833111] env[65511]: INFO networking_nsxv3.common.synchronization [req-f130064b-878b-431e-adcb-1875fc8f8d23 req-4323b593-ad64-47e1-a616-69fa392bd05c tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1172.833758] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b036a1-0362-42df-881b-ee482df8f115 with Priority: HIGHEST for action security_group_members [ 1172.834795] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6b036a1-0362-42df-881b-ee482df8f115 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.835308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.835434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.835799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.835840] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.835965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.836043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.836247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.836335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.836447] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6b036a1-0362-42df-881b-ee482df8f115',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.918164] env[65511]: INFO networking_nsxv3.common.synchronization [req-56d62643-8350-43e9-9fe8-0da7ef3704bf req-6d69a1e2-c133-4646-bb92-d83a993773ec service nova] Enqueued Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_rules [ 1172.918164] env[65511]: INFO networking_nsxv3.common.synchronization [req-56d62643-8350-43e9-9fe8-0da7ef3704bf req-6d69a1e2-c133-4646-bb92-d83a993773ec service nova] Enqueued Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1172.918862] env[65511]: INFO networking_nsxv3.common.synchronization [req-56d62643-8350-43e9-9fe8-0da7ef3704bf req-6d69a1e2-c133-4646-bb92-d83a993773ec service nova] Enqueued Resource ID: 93800e05-dd83-49a7-8eb0-1b49f7c283b3 with Priority: HIGHEST for action port [ 1172.921087] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_rules [ 1172.921087] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1172.921087] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93800e05-dd83-49a7-8eb0-1b49f7c283b3 with Priority: HIGHEST for action port [ 1172.921087] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.921087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.921087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.921087] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.921087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.923161] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.923161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.923161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.923428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.923428] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.923428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.923527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.923632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.924181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.924181] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.925416] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-93800e05-dd83-49a7-8eb0-1b49f7c283b3 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.925416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.925416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.925416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.925416] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93800e05-dd83-49a7-8eb0-1b49f7c283b3',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.338417] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.338798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.338798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.338960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.364541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.364800] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.364919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.364984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.365211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.365293] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.365378] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b036a1-0362-42df-881b-ee482df8f115 is going to be updated. [ 1173.391873] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.392090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.392144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.392388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.392546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.401589] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: IN_PROGRESS for 2s [ 1173.428091] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.429349] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.429428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.429542] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93800e05-dd83-49a7-8eb0-1b49f7c283b3 with status ACTIVE [ 1173.429877] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.429877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.429877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.430096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.430187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.430354] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.430447] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.430507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.430659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.430733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.430913] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.431122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.432454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.432454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.432454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.432454] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93800e05-dd83-49a7-8eb0-1b49f7c283b3 is going to be updated. [ 1173.456072] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.456274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.456274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.456490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.456654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.456794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93800e05-dd83-49a7-8eb0-1b49f7c283b3" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.934566] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.165935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1174.166464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.166464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.166591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.166765] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.166979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.167896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.167896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.167896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.167896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.167896] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.437836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.438578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.438578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.438578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.438578] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.438578] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 654897c8-ca85-454b-9298-fd7f00082aef is going to be created. [ 1174.463520] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.463520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.463807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.463880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.464080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.476155] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: UNINITIALIZED for 2s [ 1174.670477] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.174481] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 1175.193499] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.193653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.193753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.194052] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.194196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.194481] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.194617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.194714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.194906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.195022] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.195124] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1175.252906] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.253226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.253299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.253483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.253637] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.268209] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1175.413583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6b036a1-0362-42df-881b-ee482df8f115 in Status: SUCCESS [ 1175.413763] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6b036a1-0362-42df-881b-ee482df8f115 deletion is rescheduled due to dependency. [ 1175.413872] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6b036a1-0362-42df-881b-ee482df8f115" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.088257] env[65511]: INFO networking_nsxv3.common.synchronization [None req-df7cac7f-4e5d-4716-b524-3e5de5bf57fb tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1176.088869] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1176.089633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.089633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.089633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.089980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.090082] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.167757] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f27e067b-ccd2-4a3a-9b09-d6c1b1d66fe4 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1176.168537] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1176.169086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.169251] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.485443] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: SUCCESS [ 1176.485660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.485819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.486090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.486245] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.486360] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.486427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.486594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.486658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.486725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.486837] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.609350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.609472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.609538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.609882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.610019] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.610087] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f already deleted. [ 1176.610161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.610300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.610452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.610540] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.991039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.991039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.991039] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.991039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.991865] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.991865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.991865] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.133231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.133581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.133581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.133581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.133689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.133768] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f already deleted. [ 1177.133851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.286318] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1177.286705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.405397] env[65511]: INFO networking_nsxv3.common.synchronization [req-9a31a4a1-6f6c-4bfb-8875-14762260e21a req-0d5d22ab-f5c9-46c5-a48d-05d624fbcdf2 tempest-ServerTagsTestJSON-623628815 tempest-ServerTagsTestJSON-623628815-project-member] Enqueued Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1177.405970] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1177.406332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.406462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.406527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.406802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.407027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.407154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.407215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.407376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.407471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.407562] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.494428] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 654897c8-ca85-454b-9298-fd7f00082aef: rpc.has_security_group_logging(os_id): False [ 1177.513315] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.513602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.513602] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.513751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.514160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.514160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.514160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.514160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.514347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.514467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.515035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.515035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.515035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.515213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.515213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.515301] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.515398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.515521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.515676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.515751] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.515896] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 654897c8-ca85-454b-9298-fd7f00082aef is going to be created. [ 1177.575216] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.575216] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.575422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.575653] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.575724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.589212] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: IN_PROGRESS for 2s [ 1177.785504] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.785715] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.785840] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.786196] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.786452] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.786769] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.786928] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.787190] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.787337] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.787749] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.787749] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.787749] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.787852] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.787936] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.788045] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.788177] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.810052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.810229] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1177.810387] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.810598] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-635" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.810919] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-570980ad-5363-4c36-a496-2c9390914bf2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.811281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.811281] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.811589] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.811729] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('570980ad-5363-4c36-a496-2c9390914bf2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.911392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.911606] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.911656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.911940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.912063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.912270] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.912387] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.912453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.912633] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.912759] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.912860] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 already deleted. [ 1177.912990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.314635] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.315111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.315111] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.315362] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.315524] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.315679] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 570980ad-5363-4c36-a496-2c9390914bf2 not found, creating... [ 1178.315967] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.316128] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.316243] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.316479] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.316629] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.317042] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.317177] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.317282] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.317562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.317709] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.317863] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 570980ad-5363-4c36-a496-2c9390914bf2 is going to be created. [ 1178.341607] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.342046] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.342327] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.342799] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.343259] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.343663] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.062853] env[65511]: INFO networking_nsxv3.common.synchronization [req-9a31a4a1-6f6c-4bfb-8875-14762260e21a req-6df78bbd-ba68-44fd-bdde-68fbc790a88f service nova] Enqueued Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_rules [ 1179.062969] env[65511]: INFO networking_nsxv3.common.synchronization [req-9a31a4a1-6f6c-4bfb-8875-14762260e21a req-6df78bbd-ba68-44fd-bdde-68fbc790a88f service nova] Enqueued Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1179.063124] env[65511]: INFO networking_nsxv3.common.synchronization [req-9a31a4a1-6f6c-4bfb-8875-14762260e21a req-6df78bbd-ba68-44fd-bdde-68fbc790a88f service nova] Enqueued Resource ID: 570980ad-5363-4c36-a496-2c9390914bf2 with Priority: HIGHEST for action port [ 1179.063665] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_rules [ 1179.063772] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1179.063870] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 570980ad-5363-4c36-a496-2c9390914bf2 with Priority: HIGHEST for action port [ 1179.064189] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.064314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.064377] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.064632] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.064714] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.065551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.065673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.065772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.065988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.066167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.066268] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.066329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.066467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.066565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.066656] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.068386] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-570980ad-5363-4c36-a496-2c9390914bf2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.068493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.068591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.068831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.068906] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('570980ad-5363-4c36-a496-2c9390914bf2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.570721] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.572739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.572739] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.572739] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 570980ad-5363-4c36-a496-2c9390914bf2 with status ACTIVE [ 1179.572739] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.572999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.572999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.573075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.573654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.573654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.573654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.573654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.573654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.573899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.573899] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.573989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.574080] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.574244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.574300] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.575376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 570980ad-5363-4c36-a496-2c9390914bf2 is going to be updated. [ 1179.598059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.598059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.598059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.598059] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.598302] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.598334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-570980ad-5363-4c36-a496-2c9390914bf2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.601023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: SUCCESS [ 1179.601023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.076746] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.579592] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.579989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.579989] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.580112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.580207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.580315] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 is going to be created. [ 1180.604632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.604846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.604846] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.605062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.605220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.614564] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: UNINITIALIZED for 2s [ 1182.626171] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: SUCCESS [ 1182.626510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.626661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.626946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.627187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.627318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.627406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.627629] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.627750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.627822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.627942] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.131292] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.131557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.131672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.131935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.132215] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.132345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.132433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.133026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.133026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.133026] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.133210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.133210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.133286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.134380] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.134380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.134380] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.638407] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a56a7df-2d26-49d3-b3e5-9d00f6147b17: rpc.has_security_group_logging(os_id): False [ 1183.660259] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.660452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.660583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.660861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.661010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.661252] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.661428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.661550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.661765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.661865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.662083] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.662186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.662256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.662406] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.662485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.662684] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.662798] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.662862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.662984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.663084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.663180] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 is going to be created. [ 1183.724948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.724948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.724948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.724948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.725340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.735665] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: IN_PROGRESS for 2s [ 1184.064400] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1184.064599] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1185.751065] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: SUCCESS [ 1185.751542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.355038] env[65511]: INFO networking_nsxv3.common.synchronization [None req-fbb68bae-cc3d-4d02-a49b-657549acd8cf tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1187.355830] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1187.356210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.356315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.356368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.356689] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.356791] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.879052] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.879385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.879385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.879565] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.879667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.879769] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 already deleted. [ 1187.879878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.882998] env[65511]: INFO networking_nsxv3.common.synchronization [None req-f1d3a121-d99a-4ecb-8413-78e5ef277ff9 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1187.883557] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1187.883938] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.884039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.884102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.884296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.884467] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.409593] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.409972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.409972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.410067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.410119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.410205] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 already deleted. [ 1188.410291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.175162] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc97cc8a-fb06-48ae-8d8f-8814f85ef7b1 req-892d06db-dca9-4010-9025-0d6d9a4f7559 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1189.175757] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1189.176085] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.176219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.176284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.176536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.176718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.176815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.176871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.177046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.177149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.177274] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.500581] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.500581] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.501013] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.501013] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.501260] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.501432] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.501598] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.501910] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.501953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.502179] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.502557] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.502557] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.502557] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.502816] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.502816] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.502816] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.525820] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.526054] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1189.526259] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.526489] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.526817] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.526982] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.527121] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.527636] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.527766] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26e3cd1-29bf-422f-98a2-6e58ec83d8ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.680159] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.680437] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.680536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.680809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.681023] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.681305] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.681507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.681638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.681863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.681992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.683277] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f already deleted. [ 1189.683277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.856522] env[65511]: INFO networking_nsxv3.common.synchronization [req-7dbc7a00-da24-4458-a855-f8e0f8454ef1 req-29b4f93b-51b0-4050-94a7-36ce1a56d47d tempest-InstanceActionsTestJSON-682110489 tempest-InstanceActionsTestJSON-682110489-project-member] Enqueued Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1189.857502] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGHEST for action security_group_members [ 1189.857833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.857956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.858038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.858238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.858397] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.858497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.858560] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.858709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.858791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.858886] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.030336] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.030712] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.030909] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.031257] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.031413] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.031566] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port e26e3cd1-29bf-422f-98a2-6e58ec83d8ba not found, creating... [ 1190.031839] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.032058] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.032290] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.032582] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.032819] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.033106] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.033264] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.033383] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.033585] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.033923] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.034106] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba is going to be created. [ 1190.056521] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.056723] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.056855] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.057211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057511] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057862] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.365335] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.365335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.365335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.365534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.365670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.365898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.366380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.366380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.366380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.366380] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.366380] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 654897c8-ca85-454b-9298-fd7f00082aef is going to be updated. [ 1190.396427] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.396427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.396427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.396731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.396826] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.406626] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: IN_PROGRESS for 2s [ 1190.605676] env[65511]: INFO networking_nsxv3.common.synchronization [req-5e4096ca-8fff-4511-b3e5-c139d400421d req-d787481d-ea10-4193-9a19-9fb1ca6aa236 tempest-ServerTagsTestJSON-623628815 tempest-ServerTagsTestJSON-623628815-project-member] Enqueued Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1190.606226] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGHEST for action security_group_members [ 1190.606653] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.606878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.606943] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.607164] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.608182] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.608381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.608381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.608584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.608676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.608772] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.738656] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc97cc8a-fb06-48ae-8d8f-8814f85ef7b1 req-0a6ee056-de48-40af-b769-473eeafebe7c service nova] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1190.738734] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc97cc8a-fb06-48ae-8d8f-8814f85ef7b1 req-0a6ee056-de48-40af-b769-473eeafebe7c service nova] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1190.738824] env[65511]: INFO networking_nsxv3.common.synchronization [req-fc97cc8a-fb06-48ae-8d8f-8814f85ef7b1 req-0a6ee056-de48-40af-b769-473eeafebe7c service nova] Enqueued Resource ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with Priority: HIGHEST for action port [ 1190.739634] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1190.739808] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1190.739846] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with Priority: HIGHEST for action port [ 1190.740144] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.740282] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.740356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.740557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.740636] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.742584] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.742584] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.742584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.743047] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.743623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.743623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.743623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.743986] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.743986] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26e3cd1-29bf-422f-98a2-6e58ec83d8ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.112598] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.112598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.112598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.112855] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.113933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.113933] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.113933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.113933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.113933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.113933] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.114441] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 is going to be updated. [ 1191.145361] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.145515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.145581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.145787] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.145925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.155874] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: IN_PROGRESS for 2s [ 1191.246281] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.246795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.246877] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.248472] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with status ACTIVE [ 1191.248472] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.248472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.248686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.248886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.249058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.249379] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.249601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.249744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.249971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.250184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.250444] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.250814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.250814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.250990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.251041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.251192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba is going to be updated. [ 1191.282276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.282276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.282276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.282276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.282276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.282276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.755024] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.257581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.257821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.257821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.258042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.258140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.258240] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be created. [ 1192.284138] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.284333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.284398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.284573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.285365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.301329] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: UNINITIALIZED for 2s [ 1192.416583] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 654897c8-ca85-454b-9298-fd7f00082aef in Status: SUCCESS [ 1192.416772] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 654897c8-ca85-454b-9298-fd7f00082aef deletion is rescheduled due to dependency. [ 1192.416903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.973792] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.974305] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.974305] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.974384] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.974636] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.974791] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.974918] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.975323] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.975490] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.975684] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.975799] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.975893] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.976056] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.976170] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.976250] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.976333] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.998322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.998554] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1192.998695] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.998869] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-506" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.999283] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.999483] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999600] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.000225] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.000225] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe1c708-acd4-4f30-a848-f7bf0f0c376b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.166165] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 in Status: SUCCESS [ 1193.166794] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 deletion is rescheduled due to dependency. [ 1193.166794] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.502454] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.502691] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.502813] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.503109] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.503263] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.503600] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.503756] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.503903] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.504142] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.504311] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.504602] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.504747] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.504863] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.505079] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.505206] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.505349] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b is going to be updated. [ 1193.529349] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.529535] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.529692] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.529958] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.530286] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.530613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.258389] env[65511]: INFO networking_nsxv3.common.synchronization [req-e4a30bfe-5eeb-44be-9ba6-db73c90c963a req-a33fad8d-f07f-48f6-ad96-9808bfb8e564 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1194.258389] env[65511]: INFO networking_nsxv3.common.synchronization [req-e4a30bfe-5eeb-44be-9ba6-db73c90c963a req-a33fad8d-f07f-48f6-ad96-9808bfb8e564 service nova] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1194.258389] env[65511]: INFO networking_nsxv3.common.synchronization [req-e4a30bfe-5eeb-44be-9ba6-db73c90c963a req-a33fad8d-f07f-48f6-ad96-9808bfb8e564 service nova] Enqueued Resource ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b with Priority: HIGHEST for action port [ 1194.259469] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_rules [ 1194.259469] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1194.259469] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b with Priority: HIGHEST for action port [ 1194.259638] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.259717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.259850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.259981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.260074] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.261060] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.261233] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.261270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.261418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.261598] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.261647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.261758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.261871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.261956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.263235] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.264856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.265034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.265116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.265309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.265392] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe1c708-acd4-4f30-a848-f7bf0f0c376b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.313247] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1194.313494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.313661] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.313884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.314104] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.314222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.314294] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.314488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.314572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.314658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.314747] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.767762] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.767886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.768120] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.769021] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbe1c708-acd4-4f30-a848-f7bf0f0c376b with status ACTIVE [ 1194.769985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.769985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.769985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.769985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.769985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.769985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.770298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.770298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.770298] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.770443] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.770555] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.770655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.770655] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.771271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.771271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.771271] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbe1c708-acd4-4f30-a848-f7bf0f0c376b is going to be updated. [ 1194.793028] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.793028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.793028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.793028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.793306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.793306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe1c708-acd4-4f30-a848-f7bf0f0c376b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.816634] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.273423] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.318802] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dff95e7-f03b-454c-b9a2-d05662ca0b7f: rpc.has_security_group_logging(os_id): False [ 1195.337690] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.337832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.337904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.338137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.338228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.338549] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.338673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.338732] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.338890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.338967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.339066] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be created. [ 1195.400450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.400450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.400450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.400757] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.400793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.411802] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: IN_PROGRESS for 2s [ 1195.776614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.776790] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.776866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.777126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.777275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.777387] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1195.813588] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.813744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.813744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.813910] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.814079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.827245] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1197.425117] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1197.425408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.838674] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1197.839010] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.839211] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.839624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.839836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.839963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.840045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.840284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.840417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.840520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.840613] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.343614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.343968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.343968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.344322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.344530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.344681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.344780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.344951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.345149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.345303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.345552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.345694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.345776] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.345951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.346206] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.346277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.346343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.346488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.346563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.346656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.346776] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.752223] env[65511]: INFO networking_nsxv3.common.synchronization [req-ceccf443-fcbd-4cee-a865-66a5d46baab5 req-162831bc-2ee7-45d3-8ef4-f0928eef7ada tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1198.753068] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1198.753532] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.753707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.753810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.754119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.754352] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.754511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.754615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.755113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.755113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.755113] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.849611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1840945-a736-40d5-8bc9-389036bba1dd: rpc.has_security_group_logging(os_id): False [ 1198.870032] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.870290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.870290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.870597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.892778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.893147] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.893228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.893262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.893463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.893534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.893719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.893816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.893890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.894034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.894112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.894303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.894303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.894303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.894687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.894687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.894742] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1198.977281] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.977483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.977530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.977796] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.977974] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.010180] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1199.258146] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.258401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.258401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.258596] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.283204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.283281] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.283378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.283434] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.283623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.283709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.283826] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1199.321154] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.321365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.321464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.321883] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.333157] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1201.028975] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1201.028975] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.343882] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1201.344221] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1201.344347] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.754576] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.754947] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.141870] env[65511]: INFO networking_nsxv3.common.synchronization [req-07673623-a885-408a-91d5-f6991ffda79c req-b367d823-5b72-4d94-96a4-9d2cfd122f1b tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1205.142563] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1205.142881] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.143223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.143223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.143313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.143474] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.143566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.143630] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.143781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.143863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.143953] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.647046] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.647046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.647046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.647261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.647357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.647583] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.647708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.647777] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.647939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.648109] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.648235] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 already deleted. [ 1205.648344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.649623] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.649724] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.650521] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.650521] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.650521] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.650521] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.650767] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.650998] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.651185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.651422] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.651563] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.651722] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.651889] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.652369] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.652535] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.652700] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.672771] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.672953] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1205.673122] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.673402] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-9" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.673794] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-929c10a5-2112-466d-a43d-ea2f5b8e3627 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.674085] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.674263] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.674597] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.674760] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929c10a5-2112-466d-a43d-ea2f5b8e3627',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.177380] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.177808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.177808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.177808] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.177953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.178118] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 929c10a5-2112-466d-a43d-ea2f5b8e3627 not found, creating... [ 1206.178375] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.178530] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.178641] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.178857] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.178989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.179287] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.179465] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.179587] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.179793] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.179923] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.180076] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 929c10a5-2112-466d-a43d-ea2f5b8e3627 is going to be created. [ 1206.204089] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.204338] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.204505] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.204760] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.204944] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.205193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981487] env[65511]: INFO networking_nsxv3.common.synchronization [req-07673623-a885-408a-91d5-f6991ffda79c req-af77de2a-1977-4aa1-8143-06d60a4675aa service nova] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1206.981487] env[65511]: INFO networking_nsxv3.common.synchronization [req-07673623-a885-408a-91d5-f6991ffda79c req-af77de2a-1977-4aa1-8143-06d60a4675aa service nova] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1206.981487] env[65511]: INFO networking_nsxv3.common.synchronization [req-07673623-a885-408a-91d5-f6991ffda79c req-af77de2a-1977-4aa1-8143-06d60a4675aa service nova] Enqueued Resource ID: 929c10a5-2112-466d-a43d-ea2f5b8e3627 with Priority: HIGHEST for action port [ 1206.982286] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_rules [ 1206.982449] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1206.982549] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 929c10a5-2112-466d-a43d-ea2f5b8e3627 with Priority: HIGHEST for action port [ 1206.983767] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.985338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.985338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.985421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.985522] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.986737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.986916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.987031] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.987190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.987425] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.987549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.987549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.987780] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.987827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.987910] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.988893] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-929c10a5-2112-466d-a43d-ea2f5b8e3627 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.990323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.990323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.990323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.990323] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('929c10a5-2112-466d-a43d-ea2f5b8e3627',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.491400] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.493859] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.493859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.493859] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 929c10a5-2112-466d-a43d-ea2f5b8e3627 with status ACTIVE [ 1207.493859] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.494197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.494197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.494286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.494704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.494704] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.494704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.494704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.494916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.494916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.495478] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.495478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.495478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.495478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.495478] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.495789] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 929c10a5-2112-466d-a43d-ea2f5b8e3627 is going to be updated. [ 1207.521800] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.521972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.522049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.522264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.522408] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.522579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-929c10a5-2112-466d-a43d-ea2f5b8e3627" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.971392] env[65511]: INFO networking_nsxv3.common.synchronization [req-5978a066-d9ad-4634-88dd-1bc59dbde74c req-424d2f37-8239-42d6-a3fd-523bc3e7d7cc tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1207.972138] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1207.972985] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.972985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.972985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.975096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.975898] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.975994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.976058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.976486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.976486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.976486] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.994357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.427221] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.427434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.427584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.427845] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.428367] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.428367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.428367] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.429092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.429092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.429092] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.429092] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.429336] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.429336] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.429466] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.429844] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.429844] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.454498] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.454498] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.454498] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.454498] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-524" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.454498] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-cbe291ca-55a4-409f-8408-7d38043a50a2 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.454896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.454896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.455126] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.455282] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe291ca-55a4-409f-8408-7d38043a50a2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.483102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.483262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.483330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.483545] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.483784] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.483849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.483956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.483956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.484108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.484182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.484265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1208.496239] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.496508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.496508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.496650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.496735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.496833] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 is going to be created. [ 1208.514891] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.515149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.515265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.515601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.515821] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.526663] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1208.527958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.528170] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.528303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.528614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.528861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.539209] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: UNINITIALIZED for 2s [ 1208.958469] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.958713] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.958953] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.959353] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.959622] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.959906] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port cbe291ca-55a4-409f-8408-7d38043a50a2 not found, creating... [ 1208.960318] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.960625] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.960829] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.961313] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.961491] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.961985] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.962269] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.962464] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.962797] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.963054] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.963298] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: cbe291ca-55a4-409f-8408-7d38043a50a2 is going to be created. [ 1208.989830] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.990055] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.990055] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.990324] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.990669] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.991437] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.701476] env[65511]: INFO networking_nsxv3.common.synchronization [req-5978a066-d9ad-4634-88dd-1bc59dbde74c req-385b18ae-e7d8-43dc-84ce-5fad4332e683 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1209.701729] env[65511]: INFO networking_nsxv3.common.synchronization [req-5978a066-d9ad-4634-88dd-1bc59dbde74c req-385b18ae-e7d8-43dc-84ce-5fad4332e683 service nova] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1209.701812] env[65511]: INFO networking_nsxv3.common.synchronization [req-5978a066-d9ad-4634-88dd-1bc59dbde74c req-385b18ae-e7d8-43dc-84ce-5fad4332e683 service nova] Enqueued Resource ID: cbe291ca-55a4-409f-8408-7d38043a50a2 with Priority: HIGHEST for action port [ 1209.702386] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_rules [ 1209.702519] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1209.702618] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe291ca-55a4-409f-8408-7d38043a50a2 with Priority: HIGHEST for action port [ 1209.703889] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.704038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.704122] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.704306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.704391] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.706098] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.706219] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.706398] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe291ca-55a4-409f-8408-7d38043a50a2 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.706533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.706567] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.709499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.709499] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe291ca-55a4-409f-8408-7d38043a50a2',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.207196] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.207333] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.208653] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbe291ca-55a4-409f-8408-7d38043a50a2 with status ACTIVE [ 1210.208841] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.208958] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.209037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.209252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.209339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.209582] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.209686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.209735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.209901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.209979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.210170] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.210261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.210318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.210460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.210550] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.210637] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbe291ca-55a4-409f-8408-7d38043a50a2 is going to be updated. [ 1210.238472] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.238789] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.238874] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.239257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.239577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.239819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe291ca-55a4-409f-8408-7d38043a50a2" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.507869] env[65511]: INFO networking_nsxv3.common.synchronization [None req-e3a998d1-d356-42d1-b5a9-a31e307c7bc5 None None] Enqueued Resource ID: 867ef4b2-1c95-49c0-a6de-ce1fb4a26df4 with Priority: HIGHEST for action port [ 1210.508702] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867ef4b2-1c95-49c0-a6de-ce1fb4a26df4 with Priority: HIGHEST for action port [ 1210.510565] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-867ef4b2-1c95-49c0-a6de-ce1fb4a26df4 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.511532] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-867ef4b2-1c95-49c0-a6de-ce1fb4a26df4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.511778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-867ef4b2-1c95-49c0-a6de-ce1fb4a26df4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.512270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-867ef4b2-1c95-49c0-a6de-ce1fb4a26df4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.512487] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('867ef4b2-1c95-49c0-a6de-ce1fb4a26df4',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.539887] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1210.540366] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1210.540618] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.543349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.543727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.544099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.544354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.544521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.544820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.545027] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.545239] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.556831] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: SUCCESS [ 1210.557323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.557664] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.558064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.558424] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.558686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.558930] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.559075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.559209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.559352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.559507] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.015752] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 867ef4b2-1c95-49c0-a6de-ce1fb4a26df4 [ 1211.015752] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.015752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.016183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.016183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.016183] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.016268] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:867ef4b2-1c95-49c0-a6de-ce1fb4a26df4 already deleted. [ 1211.016364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-867ef4b2-1c95-49c0-a6de-ce1fb4a26df4" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.048679] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.063127] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.550465] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.566300] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9da7df6-aecd-4026-ab7b-ea8b45994d80: rpc.has_security_group_logging(os_id): False [ 1211.590595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.591082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.592374] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.592374] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.592374] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 is going to be created. [ 1211.672552] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.672708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.672795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.673158] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.673445] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.687307] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: IN_PROGRESS for 2s [ 1212.055409] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.055409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.055409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.055409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.055409] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.055409] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1212.084460] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.084460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.084460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.084460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.084460] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.097020] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1212.793264] env[65511]: INFO networking_nsxv3.common.synchronization [None req-fe381ab2-4f8a-47b5-8440-5665402b5eb7 None None] Enqueued Resource ID: dba9ac41-f93f-4757-8884-54df5b7c0147 with Priority: HIGHEST for action port [ 1212.793610] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba9ac41-f93f-4757-8884-54df5b7c0147 with Priority: HIGHEST for action port [ 1212.794074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-dba9ac41-f93f-4757-8884-54df5b7c0147 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.794074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dba9ac41-f93f-4757-8884-54df5b7c0147" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.794196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dba9ac41-f93f-4757-8884-54df5b7c0147" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.794350] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dba9ac41-f93f-4757-8884-54df5b7c0147" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.794434] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba9ac41-f93f-4757-8884-54df5b7c0147',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.296975] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dba9ac41-f93f-4757-8884-54df5b7c0147 [ 1213.297517] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.297620] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.297668] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.297915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.298016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.298132] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dba9ac41-f93f-4757-8884-54df5b7c0147 already deleted. [ 1213.298241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dba9ac41-f93f-4757-8884-54df5b7c0147" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.699632] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: SUCCESS [ 1213.699928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.107010] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1214.107254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.107531] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.107876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.108162] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.109364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.109364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.109364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.109364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.109364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.109364] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.612099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612472] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.612552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.612720] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612818] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.613081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613131] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.613200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.613348] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.613435] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.613508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.613652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613801] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.613890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.613946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.614095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.614167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.614243] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.614328] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.117965] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 751af4d7-7958-43dc-a40b-b5e3493c4166: rpc.has_security_group_logging(os_id): False [ 1215.136616] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.136788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.136833] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.137068] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.137163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.137378] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.137476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.137537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.137677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.137750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.137928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.138030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.138090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.138227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.138296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.138488] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.138579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.138636] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.138769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.138839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.138921] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1215.200695] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.200876] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.200928] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.201429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.201429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.218987] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1217.101960] env[65511]: INFO networking_nsxv3.common.synchronization [req-8ce66c9e-04a8-4186-8e0e-b5125bffc079 req-15131373-f740-4eca-a290-bff45bbe4cd2 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1217.102424] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1217.102744] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.102865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.102945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.103259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.103395] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.103497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.103559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.103722] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.103805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.103895] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.238678] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1217.238906] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.434933] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.435147] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.435273] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.435667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.435943] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.436634] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.436634] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.436786] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.436939] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.437592] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.437763] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.437886] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.438066] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.438188] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.438295] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.438487] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.461036] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.461185] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.461349] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.461640] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.462127] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-f5f7132e-39fd-4998-8cae-eb4a9554b608 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.463039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.463039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.463039] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.463039] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5f7132e-39fd-4998-8cae-eb4a9554b608',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.606654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.606978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.607104] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.607312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.607421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.607693] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.607844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.607909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.608076] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.608161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.608254] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f already deleted. [ 1217.608335] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.965305] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.965524] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.965652] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.965929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.966090] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.966240] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port f5f7132e-39fd-4998-8cae-eb4a9554b608 not found, creating... [ 1217.966499] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.966655] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.966767] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.966986] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.967123] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.967409] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.967664] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.967783] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.967986] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.968125] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.968262] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: f5f7132e-39fd-4998-8cae-eb4a9554b608 is going to be created. [ 1217.990664] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.990896] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.991070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.991398] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.991688] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.991980] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.731075] env[65511]: INFO networking_nsxv3.common.synchronization [req-8ce66c9e-04a8-4186-8e0e-b5125bffc079 req-a17fea4d-e3bd-428b-b35a-a79ad7130116 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1218.731429] env[65511]: INFO networking_nsxv3.common.synchronization [req-8ce66c9e-04a8-4186-8e0e-b5125bffc079 req-a17fea4d-e3bd-428b-b35a-a79ad7130116 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1218.731429] env[65511]: INFO networking_nsxv3.common.synchronization [req-8ce66c9e-04a8-4186-8e0e-b5125bffc079 req-a17fea4d-e3bd-428b-b35a-a79ad7130116 service nova] Enqueued Resource ID: f5f7132e-39fd-4998-8cae-eb4a9554b608 with Priority: HIGHEST for action port [ 1218.732387] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1218.732884] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1218.733631] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5f7132e-39fd-4998-8cae-eb4a9554b608 with Priority: HIGHEST for action port [ 1218.736797] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.736797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.736797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.736797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.736797] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.737326] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.737326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.737326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.737326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.737543] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.737696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.737801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.738041] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.738179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.738323] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.739459] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5f7132e-39fd-4998-8cae-eb4a9554b608 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.739628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.739726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.739925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.740813] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5f7132e-39fd-4998-8cae-eb4a9554b608',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.242513] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.242758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.242922] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.244354] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5f7132e-39fd-4998-8cae-eb4a9554b608 with status ACTIVE [ 1219.244738] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.244888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.244960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.245244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.245338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.245508] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.245654] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.246172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.246172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.246172] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.246172] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.246647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.246647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.246647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.246647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.246647] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5f7132e-39fd-4998-8cae-eb4a9554b608 is going to be updated. [ 1219.269329] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.269547] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.269628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.269800] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.269937] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.270123] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5f7132e-39fd-4998-8cae-eb4a9554b608" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.749128] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.252026] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.252272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.252340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.252585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.252684] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.252842] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be created. [ 1220.279024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.279024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.279024] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.279303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.279303] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.295219] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: UNINITIALIZED for 2s [ 1221.493799] env[65511]: INFO networking_nsxv3.common.synchronization [req-1f4f9910-708f-4372-aba4-9e10ae2f5408 req-375b4b9a-de60-4eb4-bd63-d5b2fd2c8da0 tempest-ServerDiskConfigTestJSON-184994122 tempest-ServerDiskConfigTestJSON-184994122-project-member] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1221.493799] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGHEST for action security_group_members [ 1221.493799] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.493799] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.494446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.494446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.494446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.494728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.494728] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.494936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.495126] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.495223] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.997858] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.998064] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.998112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.998871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.998871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.998871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.998871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.998871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.999129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.999129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.999129] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be updated. [ 1222.030034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.030034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.030034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.030034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.030269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.039935] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: IN_PROGRESS for 2s [ 1222.305977] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1222.306212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.306322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.306564] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.306771] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.306897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.306934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.307128] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.307197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.307291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.307378] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.810595] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.811060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.811060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.811171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.811309] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.811419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.811497] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.811659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.811744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.811832] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.811981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.812086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.812146] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.812287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.812426] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.812515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.812574] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.812749] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.812854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.812854] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.812947] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.316617] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1223.336926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.337186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.337186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.337365] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.337508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.337780] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.337897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.337960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.338115] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.338196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.338378] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.338467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.338527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.338669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.338744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.338927] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.339119] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.339315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.339473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.339680] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.339803] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be created. [ 1223.406356] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.406506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.406577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.406793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.406977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.424044] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1224.050786] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 in Status: SUCCESS [ 1224.051177] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 deletion is rescheduled due to dependency. [ 1224.051318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.440483] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1225.440844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.493635] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.494082] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.666714] env[65511]: INFO networking_nsxv3.common.synchronization [req-08f067a6-03b8-4fa5-bc72-05b9f7828ef3 req-2f0adca6-d1b4-42ea-a2a1-00f8aeedd6a6 tempest-ServersNegativeTestJSON-745606439 tempest-ServersNegativeTestJSON-745606439-project-member] Enqueued Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1226.667300] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1840945-a736-40d5-8bc9-389036bba1dd with Priority: HIGHEST for action security_group_members [ 1226.667708] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1840945-a736-40d5-8bc9-389036bba1dd taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.667841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.667909] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.668210] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.668461] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.668624] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.668726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.668888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.668980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.669073] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1840945-a736-40d5-8bc9-389036bba1dd',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.171338] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.171546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.171546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.171719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.171813] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.172074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.172199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.172264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.172423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.172569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.172606] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd is going to be updated. [ 1227.199615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.200391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.200391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.200391] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.200555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.212611] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: IN_PROGRESS for 2s [ 1229.225074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1840945-a736-40d5-8bc9-389036bba1dd in Status: SUCCESS [ 1229.225074] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1840945-a736-40d5-8bc9-389036bba1dd deletion is rescheduled due to dependency. [ 1229.225074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1840945-a736-40d5-8bc9-389036bba1dd" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.712835] env[65511]: INFO networking_nsxv3.common.synchronization [req-bf5be2bb-56a0-4d8d-9593-5f4146c50d4e req-68f7219d-c00c-4030-ad33-061d2b05794d tempest-AttachVolumeTestJSON-1466173553 tempest-AttachVolumeTestJSON-1466173553-project-member] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1229.713605] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGHEST for action security_group_members [ 1229.713978] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.714228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.714287] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.714499] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.714718] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.714848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.714931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.715144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.715256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.715384] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.218089] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.218286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.218331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.218727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.218727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.218884] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.218948] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.218985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.219118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.219190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.219276] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad is going to be updated. [ 1230.252035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.252035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.252035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.252035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.252035] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.261449] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: IN_PROGRESS for 2s [ 1232.273280] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad in Status: SUCCESS [ 1232.273650] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad deletion is rescheduled due to dependency. [ 1232.273650] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.093356] env[65511]: INFO networking_nsxv3.common.synchronization [req-c1a478f6-458a-40d2-9427-7e5e23a419d2 req-24995c76-88ef-4d8c-a71f-420e237bd3a0 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1233.093850] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1233.094554] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.094554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.094554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.094720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.094784] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.094829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.094888] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.095197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.095197] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.095197] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.425069] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.425069] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.425484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.425484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.425794] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.425869] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.425932] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.426162] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.426301] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.426528] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.426720] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.426720] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.426815] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.426923] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.427018] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.427149] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.449014] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.449194] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1233.449343] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.449520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.449919] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-336b8bd1-51b9-4c43-8238-2e7819354f32 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.450123] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.450242] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.450601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.450740] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336b8bd1-51b9-4c43-8238-2e7819354f32',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.597899] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.952827] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.953098] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.953219] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.953499] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.953715] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.953784] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 336b8bd1-51b9-4c43-8238-2e7819354f32 not found, creating... [ 1233.954039] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.954192] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.954303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.954514] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.954644] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.954918] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.955080] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.955193] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.955391] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.955516] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.955646] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 336b8bd1-51b9-4c43-8238-2e7819354f32 is going to be created. [ 1233.976624] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.976919] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.976997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.977243] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.977978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.977978] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.100098] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.314357] env[65511]: INFO networking_nsxv3.common.synchronization [req-c8556ff3-1b2f-46ca-9c1c-1fca38bfd69a req-117e9e84-9124-4ba5-8a2c-0f8b7d3fb178 tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1234.314895] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1234.315228] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.315340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.315420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.315594] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.315744] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.315831] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.315891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.316816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.316816] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.316816] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.603953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.604254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.604254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.606324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.606324] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.606324] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1234.639803] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.640160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.640334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.640765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.640992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.651980] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1234.717927] env[65511]: INFO networking_nsxv3.common.synchronization [req-c1a478f6-458a-40d2-9427-7e5e23a419d2 req-8577c07d-75e6-41ba-90b7-7cb89e4cb77c service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1234.718627] env[65511]: INFO networking_nsxv3.common.synchronization [req-c1a478f6-458a-40d2-9427-7e5e23a419d2 req-8577c07d-75e6-41ba-90b7-7cb89e4cb77c service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1234.718679] env[65511]: INFO networking_nsxv3.common.synchronization [req-c1a478f6-458a-40d2-9427-7e5e23a419d2 req-8577c07d-75e6-41ba-90b7-7cb89e4cb77c service nova] Enqueued Resource ID: 336b8bd1-51b9-4c43-8238-2e7819354f32 with Priority: HIGHEST for action port [ 1234.719258] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1234.719437] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1234.719598] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336b8bd1-51b9-4c43-8238-2e7819354f32 with Priority: HIGHEST for action port [ 1234.720082] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.720290] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.720389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.720867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.720867] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.721868] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.721966] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.722351] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-336b8bd1-51b9-4c43-8238-2e7819354f32 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.722513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.722609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.722828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.722941] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336b8bd1-51b9-4c43-8238-2e7819354f32',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.819017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.819180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.819226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.819424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.842336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.842589] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.842713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.842779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.842991] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.843089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.843179] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1234.871594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.871769] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.871840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.872073] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.872227] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.881918] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1235.224882] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.225124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.225326] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 336b8bd1-51b9-4c43-8238-2e7819354f32 with status ACTIVE [ 1235.225530] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.225669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.225758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.226054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.226151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.226357] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.226415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.226471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.226628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.226704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.226880] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.226973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.227046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.227186] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.227259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.227342] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 336b8bd1-51b9-4c43-8238-2e7819354f32 is going to be updated. [ 1235.247303] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.247530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.247530] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.247760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.247898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.248075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336b8bd1-51b9-4c43-8238-2e7819354f32" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.664979] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1236.664979] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.665376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.665425] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.666810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.666810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.666810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.666810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.666810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.666810] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.891987] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1236.892231] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c deletion is rescheduled due to dependency. [ 1236.892312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.168622] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.672873] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.175990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.175990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.175990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.175990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.175990] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.175990] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1238.213043] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.213043] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.213277] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.213418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.213662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.224222] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1239.720760] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.721108] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1240.235776] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 4s [ 1241.229471] env[65511]: INFO networking_nsxv3.common.synchronization [req-e0a13e60-6284-4e4a-b7f0-e48e63164836 req-936394ac-1d69-420f-b736-c43301193aca tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1241.229471] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1241.229471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.229471] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.229471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.229471] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.732318] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.234586] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.247540] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1242.247968] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.248151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.249261] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.249261] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.249261] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.737137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.737137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.737301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.738038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.738038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.738038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1242.751928] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.752157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.752237] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.752474] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.752742] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.752810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.752810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.753060] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.753162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.753252] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.753402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.753494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.753555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.753696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.753833] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.753931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.753994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.754286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.754286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.754286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.754424] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.768358] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.768506] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.768576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.768774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.768917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.780060] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1243.257063] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1243.277927] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.278156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.278156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.278598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.278719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.278971] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.279105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.279171] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.279491] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.279582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.279947] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.280071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.280071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.280195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.280271] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.280466] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.280562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.280623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.280774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.280866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.280955] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1243.406215] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.406415] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.406484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.406859] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.407315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.422949] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1244.235971] env[65511]: INFO networking_nsxv3.common.synchronization [req-68644c74-38d1-4908-8456-5b17ed35ac54 req-d80cd745-8ce5-483d-885a-b0eb967e8d9a tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1244.236595] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1244.236972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.237569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.237643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.237852] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.238076] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.238152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.238195] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.238494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.238608] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.238856] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.557082] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.557418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.557418] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.557626] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.557888] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.558184] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.558361] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.558724] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.558943] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.559247] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.559381] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.559490] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.559597] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.559713] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.559949] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.560035] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.580742] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.581113] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.581113] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.581292] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-565" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.581609] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-de058a46-3451-4049-8af5-98e41c733507 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.581789] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.581891] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.582247] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.582383] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de058a46-3451-4049-8af5-98e41c733507',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.741611] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.742270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.742270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.742270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.742270] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.742496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.742607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.742695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.742882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.742985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.743219] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1244.773844] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.773844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.773844] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.774148] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.774894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.788909] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1244.789783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1244.790018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.085187] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.085470] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.085618] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.085948] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.086135] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.086332] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port de058a46-3451-4049-8af5-98e41c733507 not found, creating... [ 1245.086697] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.086964] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.087152] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.087443] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.087608] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.088058] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.088252] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.088390] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.088650] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.088821] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.088968] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: de058a46-3451-4049-8af5-98e41c733507 is going to be created. [ 1245.109629] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.109824] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.110014] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.110304] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.110533] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.110751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.439770] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1245.440163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.809471] env[65511]: INFO networking_nsxv3.common.synchronization [req-68644c74-38d1-4908-8456-5b17ed35ac54 req-48d59162-cf1a-4a96-8136-0f380d96159c service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 1245.809760] env[65511]: INFO networking_nsxv3.common.synchronization [req-68644c74-38d1-4908-8456-5b17ed35ac54 req-48d59162-cf1a-4a96-8136-0f380d96159c service nova] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1245.809905] env[65511]: INFO networking_nsxv3.common.synchronization [req-68644c74-38d1-4908-8456-5b17ed35ac54 req-48d59162-cf1a-4a96-8136-0f380d96159c service nova] Enqueued Resource ID: de058a46-3451-4049-8af5-98e41c733507 with Priority: HIGHEST for action port [ 1245.810451] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_rules [ 1245.810592] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1245.810686] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de058a46-3451-4049-8af5-98e41c733507 with Priority: HIGHEST for action port [ 1245.811027] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.811522] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.811686] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.811924] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.812090] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.813577] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.814336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.814336] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-de058a46-3451-4049-8af5-98e41c733507 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.814336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.814336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.814336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.814336] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de058a46-3451-4049-8af5-98e41c733507',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.087039] env[65511]: INFO networking_nsxv3.common.synchronization [req-3921da15-350e-4af6-9297-8675097b6d92 req-37f002fa-1609-4a37-9420-a120f424400b tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1246.087039] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1246.089562] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.089711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.089819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.090487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.090487] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.090487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.090487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.090678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.090678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.090963] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.316752] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.316931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.317132] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de058a46-3451-4049-8af5-98e41c733507 with status ACTIVE [ 1246.317376] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.317503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.317588] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.318140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.318204] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.318421] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.318553] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.318638] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.318836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.318919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.319160] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.319274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.319348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.319521] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.319617] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.319722] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de058a46-3451-4049-8af5-98e41c733507 is going to be updated. [ 1246.343889] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.344061] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.344136] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.344351] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.344485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.344647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de058a46-3451-4049-8af5-98e41c733507" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.593611] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.802694] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1246.802694] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c deletion is rescheduled due to dependency. [ 1246.802694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.802694] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.803412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.803412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.803412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.803536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.803623] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.803705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.803797] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.096452] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.306848] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.599934] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.600215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.600215] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.600449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.600514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.600598] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1247.629714] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.629967] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.630137] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.630396] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.630557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.645366] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1247.743894] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.744125] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.744250] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.744520] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.744777] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.744929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.745086] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.745271] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.745411] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.745617] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.745725] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.745826] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.745926] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.746040] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.746143] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.746271] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.768500] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.768698] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1247.768788] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.768961] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-965" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.769307] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.769475] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.769587] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.769883] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.770066] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd706dd-a1c2-4db1-b7b5-705a43afcf12',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.809530] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.273164] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.273584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.273584] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.273850] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.273997] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.274311] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.274468] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.274592] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.274870] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.274939] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.275214] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.275369] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.275484] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.275685] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.275812] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.275955] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 is going to be updated. [ 1248.307032] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.307265] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.307427] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.307750] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.307979] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.308240] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.311914] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.312070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.312140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.312342] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.312429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.312523] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1248.344587] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.345523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.345674] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.345921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.346095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.359183] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1249.007119] env[65511]: INFO networking_nsxv3.common.synchronization [req-94240fb6-42cd-4a63-955c-5174e7935b85 req-f5c33391-0996-4f31-a485-ac95e049451a service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1249.007518] env[65511]: INFO networking_nsxv3.common.synchronization [req-94240fb6-42cd-4a63-955c-5174e7935b85 req-f5c33391-0996-4f31-a485-ac95e049451a service nova] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1249.007817] env[65511]: INFO networking_nsxv3.common.synchronization [req-94240fb6-42cd-4a63-955c-5174e7935b85 req-f5c33391-0996-4f31-a485-ac95e049451a service nova] Enqueued Resource ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with Priority: HIGHEST for action port [ 1249.008572] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_rules [ 1249.008714] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1249.008815] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with Priority: HIGHEST for action port [ 1249.009123] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.009292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.009385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.009612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.009742] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.010727] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.010839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.010922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.011149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.011310] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.011411] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.011510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.011614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.011697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.011787] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.013037] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.013242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.013242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.013402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.013539] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd706dd-a1c2-4db1-b7b5-705a43afcf12',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.515745] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.516657] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.516853] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.517123] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 with status ACTIVE [ 1249.517390] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.517563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.517681] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.518444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.518444] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.518444] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.518721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.518721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.518914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.519640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.520024] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.520191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.520480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.522038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.522038] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.522038] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bd706dd-a1c2-4db1-b7b5-705a43afcf12 is going to be updated. [ 1249.544101] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.544449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.544449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.544580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.544714] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.544886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd706dd-a1c2-4db1-b7b5-705a43afcf12" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.657382] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1249.657713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.024208] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.371463] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1250.371752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.371946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.372125] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.372339] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.372490] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.372546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.372672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.372762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.372836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.372927] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.526979] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.527417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.527417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.527417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.527557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.527662] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1250.560624] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.560845] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.560952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.561255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.561433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.572143] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1250.875201] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.378459] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0f00d64-0787-45ef-b61c-8c6c22be615c: rpc.has_security_group_logging(os_id): False [ 1251.398296] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.398556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.398556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.398842] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.398949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.399231] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.399344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.399421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.399595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.399676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.399779] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1251.481495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.481779] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.481887] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.482285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.483236] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.500370] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1252.581931] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1252.582331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.582378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.582569] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.582757] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.582873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.582939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.583177] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.583259] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.583345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.583432] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.086418] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.514913] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1253.515274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.590312] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5dfcc09-13b8-4365-8bfc-bcfd5a191d58: rpc.has_security_group_logging(os_id): False [ 1253.608949] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.609190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.609241] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.609467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.609554] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.609817] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.609994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.610116] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.610239] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.610336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.610371] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1253.683476] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.683647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.683711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.683970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.684103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.697334] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1254.010155] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.010298] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1255.719863] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1255.720378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.011254] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.011254] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1259.363276] env[65511]: INFO networking_nsxv3.common.synchronization [req-7c54b8b3-8a2f-409f-9dcf-ee3f64a4391e req-8da67672-0f4e-4a5b-b360-334311a5ffb5 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1259.363276] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1259.363669] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.363669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.363797] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.363931] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.364099] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.364191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.364301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.364404] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.364484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.364574] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.713508] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.713713] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.713826] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.714123] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.714389] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.714577] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.714722] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.714911] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.715071] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.715318] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.715390] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.715497] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.715602] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.715703] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.715803] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.715930] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.738829] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.738829] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1259.738829] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.739090] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.739384] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.739511] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.739552] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.740222] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.740222] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4550a7e5-c3d9-41ce-8a2a-71e5980259e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.867904] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.242732] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.243092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.243092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.243382] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.243529] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.243680] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 not found, creating... [ 1260.243932] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.244134] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.244317] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.244696] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.244865] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.245190] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.245383] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.245503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.245717] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.245849] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.245991] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 is going to be created. [ 1260.270419] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.270707] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.270866] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.271229] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.271570] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.271804] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.370471] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.875508] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.875508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.875508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.875508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.875508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.875508] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1260.908074] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.908074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.908074] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.908357] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.908450] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.919039] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1260.959675] env[65511]: INFO networking_nsxv3.common.synchronization [req-7c54b8b3-8a2f-409f-9dcf-ee3f64a4391e req-df1cbeb9-489b-49b9-9f95-54939e143815 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1260.959936] env[65511]: INFO networking_nsxv3.common.synchronization [req-7c54b8b3-8a2f-409f-9dcf-ee3f64a4391e req-df1cbeb9-489b-49b9-9f95-54939e143815 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1260.960159] env[65511]: INFO networking_nsxv3.common.synchronization [req-7c54b8b3-8a2f-409f-9dcf-ee3f64a4391e req-df1cbeb9-489b-49b9-9f95-54939e143815 service nova] Enqueued Resource ID: 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 with Priority: HIGHEST for action port [ 1260.960812] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1260.961032] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1260.962999] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 with Priority: HIGHEST for action port [ 1260.963254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.963428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.963498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.963708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.963787] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.965804] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.965963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.966926] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.966926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.966926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.966926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.966926] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4550a7e5-c3d9-41ce-8a2a-71e5980259e1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.469426] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.469863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.469863] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 with status ACTIVE [ 1261.470118] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.470314] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.470428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.470761] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.470920] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.471182] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.471295] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.471362] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.471593] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.471709] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.472020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.472163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.472235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.472392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.472492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.472587] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4550a7e5-c3d9-41ce-8a2a-71e5980259e1 is going to be updated. [ 1261.496480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.496705] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.496801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.497084] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.497283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.497493] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4550a7e5-c3d9-41ce-8a2a-71e5980259e1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.274278] env[65511]: INFO networking_nsxv3.common.synchronization [req-66ddef41-adf8-4176-89e4-24cf11fd19b1 req-2ad86819-900c-4bf8-b0a1-511c96e5b73a tempest-ServerActionsTestOtherA-1081528029 tempest-ServerActionsTestOtherA-1081528029-project-member] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1262.274946] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGHEST for action security_group_members [ 1262.275269] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.275393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.275459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.275658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.275813] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.275954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.275954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.276222] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.276292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.276365] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.779101] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.779446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.779446] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.779847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.779847] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.779847] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.780070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.780070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.780229] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.780307] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.780395] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be updated. [ 1262.808271] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.808486] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.808559] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.808774] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.808919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.818963] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: IN_PROGRESS for 2s [ 1262.928869] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1262.929135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.929313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.929541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.929733] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.929848] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.929914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.930118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.930200] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.930305] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.432422] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.935144] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.437736] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.437916] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.437988] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.438331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.438422] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.438525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1264.473786] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.475364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.475364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.475364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.475364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.484457] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1264.829751] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 323c831e-3e57-4559-b403-13f13a8cf909 in Status: SUCCESS [ 1264.829944] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 deletion is rescheduled due to dependency. [ 1264.830097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.227257] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.227613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.227613] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.227897] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.228266] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.228503] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.228705] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.229044] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.229285] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.229601] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.229781] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.229907] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.230022] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.230210] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.230393] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.230600] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.250304] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.250490] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1266.250605] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.250784] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-495" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.251197] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.251368] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.251487] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.251781] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.251920] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26e3cd1-29bf-422f-98a2-6e58ec83d8ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.496354] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1266.496706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.496946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.497256] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.497500] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.497626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.497692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.497860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.497956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.498062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.498133] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.754056] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.754587] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.754693] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.754974] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.755146] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.755454] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.755621] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.755736] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.755954] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.756288] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.756605] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.756780] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.756895] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.757130] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.757266] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.757406] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba is going to be updated. [ 1266.782413] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.782568] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.782723] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.784092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.784092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.784092] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.964942] env[65511]: INFO networking_nsxv3.common.synchronization [req-7c8249ff-2eff-4e89-acf9-0e4522450f23 req-c289472a-644a-4034-b7c4-9af0bc601b1f tempest-ServerActionsTestOtherB-1016976370 tempest-ServerActionsTestOtherB-1016976370-project-member] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1266.965533] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGHEST for action security_group_members [ 1266.965836] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.965957] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.966047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.966240] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.966392] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.966489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.966549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.966860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.966860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.966860] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.000312] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.000489] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.000542] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.000770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.000986] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.001093] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.001135] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.001311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.001392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.001483] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.001740] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.001915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.002013] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.002255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.002493] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.002597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.002678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.002897] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.003100] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.003235] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.003321] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.469539] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.469950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.469950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.470051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.470151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.470350] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.470456] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.470512] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.470682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.470762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.470847] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be updated. [ 1267.499894] env[65511]: INFO networking_nsxv3.common.synchronization [req-6304366b-1a50-47b9-a875-2e73e6f6478c req-d4352e6e-6aec-4c02-8a7f-8a0489a92443 service nova] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1267.499894] env[65511]: INFO networking_nsxv3.common.synchronization [req-6304366b-1a50-47b9-a875-2e73e6f6478c req-d4352e6e-6aec-4c02-8a7f-8a0489a92443 service nova] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1267.499894] env[65511]: INFO networking_nsxv3.common.synchronization [req-6304366b-1a50-47b9-a875-2e73e6f6478c req-d4352e6e-6aec-4c02-8a7f-8a0489a92443 service nova] Enqueued Resource ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with Priority: HIGHEST for action port [ 1267.500515] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_rules [ 1267.500665] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1267.500799] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with Priority: HIGHEST for action port [ 1267.502810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.502810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.502810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.502810] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.503067] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.505529] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.505669] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.506348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.506348] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.506348] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.508551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.508551] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.508551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.508551] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.511147] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.511147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.511147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.511147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.511147] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26e3cd1-29bf-422f-98a2-6e58ec83d8ba',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.511787] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1267.523267] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: IN_PROGRESS for 2s [ 1267.535749] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.535919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.535963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.536238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.536336] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.536561] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.536659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.536720] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.536878] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.536956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.537152] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.537247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.537309] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.537451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.537523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.537713] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.537805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.537864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.538016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.538110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.538194] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1267.613338] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.613454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.613507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.613727] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.613911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.629653] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1268.017034] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.017034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.017034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e26e3cd1-29bf-422f-98a2-6e58ec83d8ba with status ACTIVE [ 1268.017034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.017034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.017034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.017743] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.017743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.017743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.020890] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.021487] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.021703] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e26e3cd1-29bf-422f-98a2-6e58ec83d8ba is going to be updated. [ 1268.044362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.044907] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.045161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.045581] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.045942] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.046345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26e3cd1-29bf-422f-98a2-6e58ec83d8ba" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.523923] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.028155] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.028317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.028389] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.028607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.028696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.028795] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be updated. [ 1269.063684] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.063898] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.063973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.064257] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.064492] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.078329] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: IN_PROGRESS for 2s [ 1269.537127] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 in Status: SUCCESS [ 1269.537843] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 deletion is rescheduled due to dependency. [ 1269.537843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.651787] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1269.652152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.142770] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1270.142965] env[65511]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ba9fb822-a813-4eee-a812-940b977c608b None None] NSXv3 Agent Agent loop - iteration:3 started [ 1270.511035] env[65511]: INFO networking_nsxv3.common.synchronization [req-ad2aa265-070f-4247-b1a0-5e0f373f7566 req-5b9f8d49-b485-437b-a044-42e0b6703490 tempest-AttachVolumeNegativeTest-1865495256 tempest-AttachVolumeNegativeTest-1865495256-project-member] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1270.512630] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGHEST for action security_group_members [ 1270.513745] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.514199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.514199] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.514476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.515086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.515086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.515086] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.515322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.515520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.515735] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.018249] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.018621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.018621] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.018820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.019717] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.020401] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.020401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.020577] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.020762] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.020867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.021052] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 is going to be updated. [ 1271.056191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.056485] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.056698] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.056805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.056984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.067269] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: IN_PROGRESS for 2s [ 1271.089130] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1271.089393] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.089494] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.089710] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.089903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.090107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.090276] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.090388] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.090467] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.090557] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.090643] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.490947] env[65511]: INFO networking_nsxv3.common.synchronization [req-d2146c78-c724-460e-af1c-038afebbed7c req-7a5efe4c-b4f1-4d84-8a17-4c7c9e634f53 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1271.491488] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1271.492035] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.492165] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.492244] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.492442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.492614] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.492713] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.492788] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.492950] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.493046] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.493302] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.593365] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.994881] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.096432] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dff95e7-f03b-454c-b9a2-d05662ca0b7f: rpc.has_security_group_logging(os_id): False [ 1272.114604] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.114802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.114802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.115017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.115142] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.115353] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.115453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.115514] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.115670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.115743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.115828] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be updated. [ 1272.175864] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.176030] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.176102] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.176313] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.176463] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.189959] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: IN_PROGRESS for 2s [ 1272.497770] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.000325] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.000592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.000592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.000866] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.000959] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.001083] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1273.033521] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.033685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.033805] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.034191] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.034453] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.047783] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1273.078525] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 in Status: SUCCESS [ 1273.078710] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 deletion is rescheduled due to dependency. [ 1273.078819] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.205580] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1274.205892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.058103] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1275.058454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.493157] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.493157] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.288418] env[65511]: INFO networking_nsxv3.common.synchronization [req-6fc8c8cc-3ca5-46d3-ac95-fdcf957963fe req-dd42a7f3-6a95-45b3-97d4-8698a8aa7ac0 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1281.288954] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1281.289668] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.289802] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.289871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.290096] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.290276] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.290386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.290452] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.290612] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.290708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.290818] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.599313] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.599562] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.599693] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.599957] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.600272] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.600434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.600551] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.600766] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.600905] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.601299] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1281.601371] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1281.601481] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1281.601592] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1281.601698] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1281.601800] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1281.601926] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1281.622318] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1281.622472] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1281.622585] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1281.622757] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.623067] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.623236] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.623354] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.623710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.623850] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725c1165-d2a5-4bdb-9e2c-c8ce97357e08',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.793673] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.126021] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.126267] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.126393] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.126670] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.126832] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.127026] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 not found, creating... [ 1282.127242] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.127397] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.127523] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.127751] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.127886] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.128200] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.128364] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.128480] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.128683] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.128812] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.128962] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 is going to be created. [ 1282.149240] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.149451] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.149597] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.150197] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.150197] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.150918] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.296328] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.798874] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.799117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.799117] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.799346] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.799455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.799597] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1282.828925] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.829178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.829178] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.829353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.829513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.839302] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1283.244267] env[65511]: INFO networking_nsxv3.common.synchronization [req-6fc8c8cc-3ca5-46d3-ac95-fdcf957963fe req-e73ed3c0-1f01-4cab-a461-52842db96413 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1283.244455] env[65511]: INFO networking_nsxv3.common.synchronization [req-6fc8c8cc-3ca5-46d3-ac95-fdcf957963fe req-e73ed3c0-1f01-4cab-a461-52842db96413 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1283.244620] env[65511]: INFO networking_nsxv3.common.synchronization [req-6fc8c8cc-3ca5-46d3-ac95-fdcf957963fe req-e73ed3c0-1f01-4cab-a461-52842db96413 service nova] Enqueued Resource ID: 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 with Priority: HIGHEST for action port [ 1283.245145] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1283.245328] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1283.245400] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 with Priority: HIGHEST for action port [ 1283.245625] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.245743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.245809] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.245999] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.246087] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.247221] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.247315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.247511] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.247611] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.247701] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.247835] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.247908] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725c1165-d2a5-4bdb-9e2c-c8ce97357e08',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.750592] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.750592] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.797673] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 with status ACTIVE [ 1283.797673] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.797673] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.797673] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.797673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.797673] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 725c1165-d2a5-4bdb-9e2c-c8ce97357e08 is going to be updated. [ 1283.799049] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.799049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.799049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.799049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.799049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.799049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725c1165-d2a5-4bdb-9e2c-c8ce97357e08" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.850834] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1284.851386] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.851516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.851711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.851981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.852149] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.852228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.852418] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.852540] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.852661] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.355741] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.859688] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.362057] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.362315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.362315] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.362660] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.362745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.362884] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1286.392803] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.393070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.393070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.393363] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.393579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.403072] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1288.246772] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.247209] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1288.418369] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1288.418561] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.418734] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.418954] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.419167] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.419285] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.419349] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.419562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.419691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.419691] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.419788] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.922983] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.923228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.923228] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.923449] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.923632] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.923733] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.923795] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.923956] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.924049] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.924140] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.924286] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.924378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.924441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.924583] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.924719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.924807] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.924865] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.925077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.925181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.925273] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.925362] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.428653] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1289.447892] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.448130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.448130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.448308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.448421] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.448659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.448763] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.448840] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.448973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.449062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.449258] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.449355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.449416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.449562] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.449631] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.449810] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.449902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.449965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.450114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.450187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.450270] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1289.517990] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.518279] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.518413] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.518744] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.518978] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.537864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1291.095992] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.095992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.095992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.096538] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.096538] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.561390] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1291.562062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.598719] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.101636] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.604229] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1292.604411] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1293.248475] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.248475] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.580510] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.580775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.580775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.580932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.592948] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1293.593921] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.595153] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1293.638981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.639231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.639231] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.639464] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.651947] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.652835] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1293.653033] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.653033] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1293.707703] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.707857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.707923] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.708156] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.709548] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.709745] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1293.803541] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.803712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.803755] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.803969] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.804353] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.804660] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1293.927717] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.927963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.927963] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.928166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.928518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.928834] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1293.928929] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5a56a7df-2d26-49d3-b3e5-9d00f6147b17', 'e5dfcc09-13b8-4365-8bfc-bcfd5a191d58', '751af4d7-7958-43dc-a40b-b5e3493c4166', 'a9da7df6-aecd-4026-ab7b-ea8b45994d80', '4f5cf34d-8c17-41c9-bf34-af48acdaf496', '9e10b5b1-3407-4c5d-90d3-1dec0da978ad', '647f1aad-d1e8-4e71-b6f5-f70e5b3b779e', '0dff95e7-f03b-454c-b9a2-d05662ca0b7f', 'c93b960e-abb3-45de-8b0b-bd1536ab4bca', '323c831e-3e57-4559-b403-13f13a8cf909', '22614963-faca-462c-8364-ac7ae98c2969', 'f4aa4c41-7e6c-4db5-9705-5907decf8f0a', '3d2f242b-f07c-4860-9f69-67ee36089fce', '479f3d06-9c02-42eb-90b2-95e362b2945a', 'c5850f55-9492-4366-816e-5251bfefc2bb', '1790ab65-8d50-4bf4-aa35-1b139b74d5a6', '83993e26-a536-4b93-ac9b-bdc8e2e16ee7', '9a82020c-f023-4af6-a870-9b8623205ed1', '654897c8-ca85-454b-9298-fd7f00082aef', 'c75da86d-70ea-4fc8-86a4-c249315ae94c', '49eab9c1-0cf4-4ab1-83f1-830592c0f740', 'aa967685-2731-4317-8bda-67f4fab2547f', '0211564f-7b41-42e2-85dc-08114fde7981', '1bef7c22-495d-4b65-b8bf-57eb4115026b', 'e1840945-a736-40d5-8bc9-389036bba1dd', '2777b4e0-28a1-4987-85d5-9f30569a8c3c', '1502e09d-ef5c-4d75-b759-794a7bb5c0cf', 'fc6ba1de-c29f-4e62-9821-c0d2a45ac1d8', '897a9691-2826-4bf1-8977-6d7594c8df89', '194fa0c5-1d79-49ff-a422-ac14c6d25717', '1dd306dd-83f9-434d-a479-235e5cd1d98f', 'b0f00d64-0787-45ef-b61c-8c6c22be615c', '6f6d2b7b-7f21-42a2-84a8-572f5519d7d0', 'bd325407-ae36-43a1-abed-91fd5cc630ba', 'ee64cf57-98ae-44f7-84e3-20cf3c5c2489', 'a0614801-abc8-4a0a-a4f8-e0e682a1e02c', '95d278ea-5c85-431d-b2c5-e2b81a141e5f', 'f6b036a1-0362-42df-881b-ee482df8f115', '9441a081-4c23-4898-9876-4df61d261ed0', 'bc42862b-f71b-41f8-ad04-30546bed9ee5', 'b22e9f87-12dd-4e82-864b-ae5b61fc4413', 'ad2505d7-9740-4169-97c7-e850756cca9e', 'a7ce43c3-59e1-4b66-8efa-669b47d29012', '232b7b09-b30d-4f2e-95a8-0315ce8667b1', '9d28d366-53ef-44cf-aae9-28a5d620d19b', 'ab4de9da-a8ca-4370-af21-e316dc775aee', '964f8cb2-18ad-4766-ae61-bda439ab5514', 'c0746379-de9c-4dc8-baf1-40ed27bd5a2c', '48fd9074-e82c-4b2f-86bc-96c1badeaa2e', 'fd7e334b-4f27-4441-85ca-d5b22f8c8f07', '53044249-4154-4da6-ae48-a91634987f8e'} {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.929043] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1293.947941] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.948176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.948176] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.948354] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.948471] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.948586] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1293.948656] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1293.948726] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1294.077871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.078138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.078138] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.078311] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.079566] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.079838] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1294.079916] env[65511]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65511) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.079989] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1294.080069] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1294.080152] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1294.080222] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGH for action security_group_rules [ 1294.080303] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 1294.080377] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGH for action security_group_rules [ 1294.080478] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGH for action security_group_rules [ 1294.080544] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGH for action security_group_rules [ 1294.080605] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGH for action security_group_rules [ 1294.080666] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGH for action security_group_rules [ 1294.080727] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGH for action security_group_rules [ 1294.080787] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGH for action security_group_rules [ 1294.080887] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 1294.080933] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGH for action security_group_rules [ 1294.080977] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 1294.081031] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGH for action security_group_rules [ 1294.081081] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGH for action security_group_rules [ 1294.081140] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGH for action security_group_rules [ 1294.081202] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 1294.081261] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGH for action security_group_rules [ 1294.081321] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGH for action security_group_rules [ 1294.081398] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGH for action security_group_rules [ 1294.081513] env[65511]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGH for action security_group_rules [ 1294.081639] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.265282] env[65511]: INFO networking_nsxv3.common.synchronization [req-729ca4a5-2b8f-4716-aa79-fe95b7fe1838 req-9ddd5543-9c78-4617-aeb0-f85138ae4cc2 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1297.265848] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1297.265971] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 with Priority: HIGH for action security_group_rules [ 1297.266116] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 with Priority: HIGH for action security_group_rules [ 1297.266183] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e with Priority: HIGH for action security_group_rules [ 1297.266275] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5850f55-9492-4366-816e-5251bfefc2bb with Priority: HIGH for action security_group_rules [ 1297.266389] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c75da86d-70ea-4fc8-86a4-c249315ae94c with Priority: HIGH for action security_group_rules [ 1297.266446] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654897c8-ca85-454b-9298-fd7f00082aef with Priority: HIGH for action security_group_rules [ 1297.266534] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a82020c-f023-4af6-a870-9b8623205ed1 with Priority: HIGH for action security_group_rules [ 1297.266621] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 with Priority: HIGH for action security_group_rules [ 1297.266708] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 479f3d06-9c02-42eb-90b2-95e362b2945a with Priority: HIGH for action security_group_rules [ 1297.266795] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 with Priority: HIGH for action security_group_rules [ 1297.266880] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2f242b-f07c-4860-9f69-67ee36089fce with Priority: HIGH for action security_group_rules [ 1297.266966] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a with Priority: HIGH for action security_group_rules [ 1297.267082] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22614963-faca-462c-8364-ac7ae98c2969 with Priority: HIGH for action security_group_rules [ 1297.267173] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323c831e-3e57-4559-b403-13f13a8cf909 with Priority: HIGH for action security_group_rules [ 1297.267268] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca with Priority: HIGH for action security_group_rules [ 1297.267338] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad with Priority: HIGH for action security_group_rules [ 1297.267421] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGH for action security_group_rules [ 1297.267506] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 with Priority: HIGH for action security_group_rules [ 1297.267610] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 with Priority: HIGH for action security_group_rules [ 1297.267672] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 with Priority: HIGH for action security_group_rules [ 1297.267948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.268079] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.268144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.268339] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.268502] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.268598] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.268678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.268825] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.268908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.269033] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.270307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.270458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.270458] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.270584] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.270627] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a56a7df-2d26-49d3-b3e5-9d00f6147b17',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.272020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-751af4d7-7958-43dc-a40b-b5e3493c4166 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.272020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.272020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.272020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.272020] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('751af4d7-7958-43dc-a40b-b5e3493c4166',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.272501] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.272582] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.272806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.272806] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.272918] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('647f1aad-d1e8-4e71-b6f5-f70e5b3b779e',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.273563] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5850f55-9492-4366-816e-5251bfefc2bb taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.273677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.273891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.275585] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.275680] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5850f55-9492-4366-816e-5251bfefc2bb',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.277137] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c75da86d-70ea-4fc8-86a4-c249315ae94c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.277266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.277316] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.277613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.277613] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c75da86d-70ea-4fc8-86a4-c249315ae94c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.278918] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-654897c8-ca85-454b-9298-fd7f00082aef taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.278918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.278918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.278918] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.278918] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('654897c8-ca85-454b-9298-fd7f00082aef',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.279210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a82020c-f023-4af6-a870-9b8623205ed1 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.279343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.279394] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.279571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.279571] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a82020c-f023-4af6-a870-9b8623205ed1',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.280996] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.280996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.280996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.280996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.280996] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83993e26-a536-4b93-ac9b-bdc8e2e16ee7',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.281386] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-479f3d06-9c02-42eb-90b2-95e362b2945a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.281528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.281590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.282220] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.282220] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('479f3d06-9c02-42eb-90b2-95e362b2945a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.282509] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.282823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.282823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.282823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.282823] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1790ab65-8d50-4bf4-aa35-1b139b74d5a6',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.285860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2f242b-f07c-4860-9f69-67ee36089fce taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.285860] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2f242b-f07c-4860-9f69-67ee36089fce',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.285860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.285860] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aa4c41-7e6c-4db5-9705-5907decf8f0a',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.285860] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22614963-faca-462c-8364-ac7ae98c2969 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.285860] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.286466] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22614963-faca-462c-8364-ac7ae98c2969',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.286599] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-323c831e-3e57-4559-b403-13f13a8cf909 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.286726] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.286770] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.286892] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.286964] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('323c831e-3e57-4559-b403-13f13a8cf909',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.287633] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.287746] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.287793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.288088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.288088] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93b960e-abb3-45de-8b0b-bd1536ab4bca',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.288758] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.288862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.288926] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.289101] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.289154] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e10b5b1-3407-4c5d-90d3-1dec0da978ad',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.290202] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.290202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.290202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.290202] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.290202] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.290796] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.292017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.292017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.292017] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.292017] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5cf34d-8c17-41c9-bf34-af48acdaf496',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.292017] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.292541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.292541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.292541] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.292541] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5dfcc09-13b8-4365-8bfc-bcfd5a191d58',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.293440] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.293440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.293440] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.293615] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.293615] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9da7df6-aecd-4026-ab7b-ea8b45994d80',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.317690] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.317899] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.318042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.318308] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.322856] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.322972] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.341384] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.341731] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a56a7df-2d26-49d3-b3e5-9d00f6147b17 is going to be deleted. [ 1297.343299] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.343515] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.371054] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.371054] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 647f1aad-d1e8-4e71-b6f5-f70e5b3b779e is going to be deleted. [ 1297.412405] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.412622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.412622] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.412766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.412857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.412977] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a56a7df-2d26-49d3-b3e5-9d00f6147b17" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.424318] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.424523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.424523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.424735] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.424829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.424952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-647f1aad-d1e8-4e71-b6f5-f70e5b3b779e" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.563316] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.563505] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.563633] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.563905] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.564171] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.564326] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.564444] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.564667] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.564839] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.565076] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.565193] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1297.565302] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1297.565411] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1297.565521] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.565626] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1297.565758] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1297.590916] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1297.591207] env[65511]: DEBUG dogpile.cache.region [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1297.591440] env[65511]: DEBUG dogpile.lock [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1297.591690] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.592172] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.592441] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.592620] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.593070] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.593319] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ca8a66d-ae75-4069-9bdd-48dff6b3b376',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.801207] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.806136] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.806428] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.806500] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.806707] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.806919] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.807057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.807124] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.807318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.807442] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.807571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.807728] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.876999] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.877223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.877272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.877552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.879362] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.879468] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.880214] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.880359] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.882020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.882161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.882953] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.883057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.883767] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.883867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.884610] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.884700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.885412] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.885503] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.895188] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.895330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.896218] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.896330] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.897163] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.897163] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.897786] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.898213] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.898291] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.898986] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.899386] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.899473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.900197] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.900605] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.900697] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.901366] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.901771] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.901894] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.902595] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.902956] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.903105] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.906844] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1297.907306] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.907416] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 479f3d06-9c02-42eb-90b2-95e362b2945a is going to be deleted. [ 1297.908382] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.908590] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.910948] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.911108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.931980] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.932486] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 323c831e-3e57-4559-b403-13f13a8cf909 is going to be deleted. [ 1297.934182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.934182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.960961] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.961074] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5850f55-9492-4366-816e-5251bfefc2bb is going to be deleted. [ 1297.961951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.962507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.985827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.986081] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a82020c-f023-4af6-a870-9b8623205ed1 is going to be deleted. [ 1297.986917] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.987153] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.001450] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.001676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.002446] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.002507] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.015272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.015413] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22614963-faca-462c-8364-ac7ae98c2969 is going to be deleted. [ 1298.016814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.017118] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.052066] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.052272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.053225] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.053369] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c75da86d-70ea-4fc8-86a4-c249315ae94c is going to be deleted. [ 1298.054289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.054498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.081724] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.081875] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5cf34d-8c17-41c9-bf34-af48acdaf496 is going to be deleted. [ 1298.082791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.083016] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.098132] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.098521] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.098601] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.098883] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.099042] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.099198] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Segment Port 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 not found, creating... [ 1298.099456] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.099609] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.099722] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.099988] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.100073] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.100358] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.100580] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.100701] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.100929] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.101041] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.101177] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Resource: SegmentPort with ID: 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 is going to be created. [ 1298.112332] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.112534] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.116388] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.116523] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.142685] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.142879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aa4c41-7e6c-4db5-9705-5907decf8f0a is going to be deleted. [ 1298.143861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.144099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.146710] env[65511]: DEBUG networking_nsxv3.common.locking [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.146899] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.147032] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.147296] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.147530] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.147755] env[65511]: DEBUG oslo_concurrency.lockutils [None req-f051dfe7-5289-4c24-80f8-884d797a0d31 None None] Releasing lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.213958] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.214212] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.249278] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.249490] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2f242b-f07c-4860-9f69-67ee36089fce is going to be deleted. [ 1298.250264] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.250568] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.277780] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.278208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.323556] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.328366] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.344314] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.344572] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.350864] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.351110] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e10b5b1-3407-4c5d-90d3-1dec0da978ad is going to be deleted. [ 1298.352223] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.352454] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.407827] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.408040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5dfcc09-13b8-4365-8bfc-bcfd5a191d58 is going to be deleted. [ 1298.409150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.409392] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.443033] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.443286] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.444099] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.444207] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83993e26-a536-4b93-ac9b-bdc8e2e16ee7 is going to be deleted. [ 1298.445317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.445556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.499678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.499851] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93b960e-abb3-45de-8b0b-bd1536ab4bca is going to be deleted. [ 1298.501051] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.501301] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.568041] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.568247] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.580911] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.581144] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.582266] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.582392] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1790ab65-8d50-4bf4-aa35-1b139b74d5a6 is going to be deleted. [ 1298.583338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.583563] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.584964] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.585091] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.667994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.667994] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9da7df6-aecd-4026-ab7b-ea8b45994d80 is going to be deleted. [ 1298.668368] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.668811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.802700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.802916] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 654897c8-ca85-454b-9298-fd7f00082aef is going to be deleted. [ 1298.803889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.804147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.805818] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.805934] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.824951] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.825179] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.825438] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.825571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.825648] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.825811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.825895] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.825964] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1298.830067] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dff95e7-f03b-454c-b9a2-d05662ca0b7f: rpc.has_security_group_logging(os_id): False [ 1298.849169] env[65511]: INFO networking_nsxv3.common.synchronization [req-729ca4a5-2b8f-4716-aa79-fe95b7fe1838 req-1cea0559-c0df-469b-a0e0-269460c85d7a service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1298.849340] env[65511]: INFO networking_nsxv3.common.synchronization [req-729ca4a5-2b8f-4716-aa79-fe95b7fe1838 req-1cea0559-c0df-469b-a0e0-269460c85d7a service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1298.849478] env[65511]: INFO networking_nsxv3.common.synchronization [req-729ca4a5-2b8f-4716-aa79-fe95b7fe1838 req-1cea0559-c0df-469b-a0e0-269460c85d7a service nova] Enqueued Resource ID: 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 with Priority: HIGHEST for action port [ 1298.850021] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1298.850736] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1298.850871] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 with Priority: HIGHEST for action port [ 1298.851191] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.851352] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.851403] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.851693] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.851780] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.852681] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.852771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.852981] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.853108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.853152] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.853329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.853431] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ca8a66d-ae75-4069-9bdd-48dff6b3b376',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.907151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.907344] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 751af4d7-7958-43dc-a40b-b5e3493c4166 is going to be deleted. [ 1298.908250] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.908504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.908601] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.908700] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-323c831e-3e57-4559-b403-13f13a8cf909" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.909274] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.909537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.909682] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.909889] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-479f3d06-9c02-42eb-90b2-95e362b2945a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.910772] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.911048] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.911208] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.911441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5850f55-9492-4366-816e-5251bfefc2bb" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.911614] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.911839] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.911976] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.912196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22614963-faca-462c-8364-ac7ae98c2969" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.912424] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.912643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.912861] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a82020c-f023-4af6-a870-9b8623205ed1" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.913504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.913628] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913783] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c75da86d-70ea-4fc8-86a4-c249315ae94c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.914160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.914265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.914419] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5cf34d-8c17-41c9-bf34-af48acdaf496" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.914586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.914778] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.914882] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.915045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aa4c41-7e6c-4db5-9705-5907decf8f0a" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.915213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.915401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.915504] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.915678] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2f242b-f07c-4860-9f69-67ee36089fce" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.915868] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.916082] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.916190] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.916355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e10b5b1-3407-4c5d-90d3-1dec0da978ad" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.916552] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.916748] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.916862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.917045] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83993e26-a536-4b93-ac9b-bdc8e2e16ee7" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.917711] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.917922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.918072] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.918272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5dfcc09-13b8-4365-8bfc-bcfd5a191d58" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.918488] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.918699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.918823] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.919009] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93b960e-abb3-45de-8b0b-bd1536ab4bca" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.919207] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.919417] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.919535] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.919696] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1790ab65-8d50-4bf4-aa35-1b139b74d5a6" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.921102] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.921296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.921398] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.921625] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.954420] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.954643] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.004677] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.004971] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.005929] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.006480] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.006480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.006480] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.006699] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.006754] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.006864] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be updated. [ 1299.008355] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.008536] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.008647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.008781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9da7df6-aecd-4026-ab7b-ea8b45994d80" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.008936] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.009145] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.009242] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.009414] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-654897c8-ca85-454b-9298-fd7f00082aef" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.029903] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.030129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.030129] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.030329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.030647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.062322] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1299.122624] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.122857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.122857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.123155] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.123253] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.123385] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-751af4d7-7958-43dc-a40b-b5e3493c4166" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.207544] env[65511]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.208193] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.208476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.208586] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.208764] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.208903] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.281185] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: IN_PROGRESS for 2s [ 1299.356106] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.356322] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.356540] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 with status ACTIVE [ 1299.356754] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.356901] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.356994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.357296] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.357423] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358056] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.358056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.358056] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.358345] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.358433] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358629] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.358740] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.358793] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.359162] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.359255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.359313] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ca8a66d-ae75-4069-9bdd-48dff6b3b376 is going to be updated. [ 1299.386086] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.386326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.386326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.386556] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.386703] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.386863] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ca8a66d-ae75-4069-9bdd-48dff6b3b376" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.073803] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1301.074283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.074283] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.074432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.074622] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.074741] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.074811] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.074981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.075088] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.075163] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.299493] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1301.299760] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.576973] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.079096] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.582527] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.582527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.582527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.582527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.582527] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.582527] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1302.614495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.614495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.614495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.614495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.614908] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.625382] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1303.851990] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.852432] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1304.656034] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1304.656034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.656034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.656034] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.656034] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.656465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.656465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.656465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.656465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.656465] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.656618] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.159719] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.160110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.160110] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.160201] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.160402] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.160595] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.160659] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.160850] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.160945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.161050] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.161221] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.161325] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.161405] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.161573] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.161747] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.161843] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.161902] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.162077] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.162168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.162289] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.162367] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.269556] env[65511]: INFO networking_nsxv3.common.synchronization [req-f9110ba0-c9b8-4881-8492-21f6da1764fc req-a60ae69a-4a4d-4061-9f91-37319ef28abb tempest-ServerActionsTestJSON-1691402330 tempest-ServerActionsTestJSON-1691402330-project-member] Enqueued Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1305.270461] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f00d64-0787-45ef-b61c-8c6c22be615c with Priority: HIGHEST for action security_group_members [ 1305.270906] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0f00d64-0787-45ef-b61c-8c6c22be615c taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.271130] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.271255] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.271475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.271654] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.271765] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.271829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.272018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.272168] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.272329] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0f00d64-0787-45ef-b61c-8c6c22be615c',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.664353] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1305.684993] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.685221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.685221] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.685441] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.704238] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.704522] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.704640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.704704] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.704904] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.704985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.705181] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.705275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.705327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.705475] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.705549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.705737] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.705829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.705885] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.706063] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.706113] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.706181] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1305.768343] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.768634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.768634] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.768766] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.768915] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.776130] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.776344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.776344] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.776549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.791971] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1305.799533] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.799773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.799891] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.799951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.800182] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.800265] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.800358] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c is going to be updated. [ 1305.829902] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.830180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.830180] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.830376] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.830511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.841706] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: IN_PROGRESS for 2s [ 1307.810250] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1307.810662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.852057] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0f00d64-0787-45ef-b61c-8c6c22be615c in Status: SUCCESS [ 1307.852376] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0f00d64-0787-45ef-b61c-8c6c22be615c deletion is rescheduled due to dependency. [ 1307.852571] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0f00d64-0787-45ef-b61c-8c6c22be615c" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.581390] env[65511]: INFO networking_nsxv3.common.synchronization [req-a5ea2339-00c9-4aa0-8ce6-0ed0fa395edb req-908fd65c-0b2d-4c9f-9a60-0bf2c57b1bf4 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1308.581390] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1308.581686] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.581771] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.581851] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.582069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.582219] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.582321] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.582383] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.582591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.582670] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.582818] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.085406] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.588112] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.090534] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.091098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.091098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.091098] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.091248] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.091248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1310.126321] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.126537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.126642] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.126935] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.127160] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.140808] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1312.152482] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1312.152960] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.582390] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.582798] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.203495] env[65511]: INFO networking_nsxv3.common.synchronization [req-048e9016-32e2-47d1-bbbb-3c62355385f5 req-e66787b0-089d-4e30-b534-e09e865b658c tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1315.203495] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1315.203495] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.203495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.203495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.203495] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.203952] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.203952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.203952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.203952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.204147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.204251] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.706621] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.210048] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.712455] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.712708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.712708] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.712970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.712970] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.713112] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1316.745274] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.745476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.745476] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.745687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.745836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.757163] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1318.769598] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1318.769973] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.908020] env[65511]: INFO networking_nsxv3.common.synchronization [req-5a20b4db-1257-469b-8fb5-0420ef9a2f68 req-5ae14c3e-f05f-4cbb-87cb-0bd9b4079b69 tempest-AttachVolumeShelveTestJSON-724635459 tempest-AttachVolumeShelveTestJSON-724635459-project-member] Enqueued Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1319.908020] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f with Priority: HIGHEST for action security_group_members [ 1319.908020] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.908020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.908020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.908020] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.909148] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.909292] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.909371] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.909781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.909781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.909781] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dff95e7-f03b-454c-b9a2-d05662ca0b7f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.411910] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.412157] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.412213] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.412407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.412513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.412702] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.412803] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.412880] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.413089] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.413185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.413270] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f is going to be updated. [ 1320.445773] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.445981] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.446127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.446429] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.446626] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.456265] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: IN_PROGRESS for 2s [ 1322.467645] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f in Status: SUCCESS [ 1322.468039] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dff95e7-f03b-454c-b9a2-d05662ca0b7f deletion is rescheduled due to dependency. [ 1322.468039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dff95e7-f03b-454c-b9a2-d05662ca0b7f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.451188] env[65511]: INFO networking_nsxv3.common.synchronization [req-b91dc9fe-2938-4e11-84c3-530643e99f61 req-95497f49-ad80-44d4-a9de-a6ff3d7c16e8 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1324.451738] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1324.452059] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.452188] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.452254] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.452459] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.452615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.452712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.452775] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.452925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.453018] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.453313] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.743676] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.743867] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.743989] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.744268] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.744523] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.744677] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.744790] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.745009] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.745318] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.745531] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.745646] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.745753] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.745860] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.745966] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.746080] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.746206] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.767701] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.767865] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1324.767993] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.768185] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.768498] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-18665f40-2e1f-4778-924d-5e5f7486c765 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.768709] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.768833] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.769203] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.769342] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18665f40-2e1f-4778-924d-5e5f7486c765',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.957681] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.271926] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.272175] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.272303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.272588] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.272734] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.272888] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 18665f40-2e1f-4778-924d-5e5f7486c765 not found, creating... [ 1325.273404] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.273404] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.273572] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.273661] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.273792] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.274083] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.274236] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.274352] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.274556] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.274685] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.274820] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 18665f40-2e1f-4778-924d-5e5f7486c765 is going to be created. [ 1325.299938] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.300172] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.300279] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.300546] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.300818] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.301052] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.459840] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.962238] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.962473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.962591] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.963032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.963032] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.963248] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1325.990431] env[65511]: INFO networking_nsxv3.common.synchronization [req-b91dc9fe-2938-4e11-84c3-530643e99f61 req-ae9f2d93-dcd3-4bb7-b828-0afc71db2847 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1325.990609] env[65511]: INFO networking_nsxv3.common.synchronization [req-b91dc9fe-2938-4e11-84c3-530643e99f61 req-ae9f2d93-dcd3-4bb7-b828-0afc71db2847 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1325.990912] env[65511]: INFO networking_nsxv3.common.synchronization [req-b91dc9fe-2938-4e11-84c3-530643e99f61 req-ae9f2d93-dcd3-4bb7-b828-0afc71db2847 service nova] Enqueued Resource ID: 18665f40-2e1f-4778-924d-5e5f7486c765 with Priority: HIGHEST for action port [ 1325.992210] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.992343] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.992412] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.992613] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.992758] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.994065] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1325.994205] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1325.994307] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18665f40-2e1f-4778-924d-5e5f7486c765 with Priority: HIGHEST for action port [ 1325.994575] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.994677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.994745] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.994925] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.995011] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.995895] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.996042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.996304] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-18665f40-2e1f-4778-924d-5e5f7486c765 taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.996432] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.996510] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.996675] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.996782] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18665f40-2e1f-4778-924d-5e5f7486c765',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.008852] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1326.499659] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.500039] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.500117] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18665f40-2e1f-4778-924d-5e5f7486c765 with status ACTIVE [ 1326.500298] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.500402] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.500473] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.500677] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.500808] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.501021] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.501185] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.501297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.501481] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.501551] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.501761] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.501877] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.501932] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.502097] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.502198] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.502329] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18665f40-2e1f-4778-924d-5e5f7486c765 is going to be updated. [ 1326.525408] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.525646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.525646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.525815] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.525952] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.526127] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18665f40-2e1f-4778-924d-5e5f7486c765" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.023237] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1328.023640] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.023849] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.024181] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.024407] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.024549] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.024656] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.024886] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.025028] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.025148] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.527867] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.030194] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.532395] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.532576] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.532652] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.532873] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.532962] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.533090] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1329.571950] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.572167] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.572297] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.572575] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.572736] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.581996] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1330.996079] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.996386] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1331.593607] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1331.593607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.593607] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.593871] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.593871] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.593998] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.594058] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.594919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.594919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.594919] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.594919] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.096879] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.097318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.097318] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.097407] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.097558] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.097667] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.097729] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.098081] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.099075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.099075] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.099075] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.099427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.099427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.099427] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.099427] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.602455] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1332.622783] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.623037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.623037] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.623246] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.623338] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.623560] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.623662] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.623719] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.623867] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.623945] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.624175] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.624269] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.624323] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.624469] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.624555] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.624741] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.624829] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.624896] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.625029] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.625107] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.625192] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1332.691734] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.691955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.691955] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.692174] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.692329] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.712603] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1334.742208] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1334.742647] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.892202] env[65511]: INFO networking_nsxv3.common.synchronization [req-307b246b-ffcd-4e5b-afd6-152b40ba9147 req-c29da156-83ad-4717-9529-41ef7fa3e8f8 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1335.892559] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1335.892870] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.892992] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.893071] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.893416] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.893416] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.893558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.893558] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.893702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.893828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.893871] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.395876] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.898599] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.400768] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.401040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.401040] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.401284] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.401381] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.401476] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1337.433533] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.433721] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.433830] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.433946] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.434114] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.443522] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1339.456097] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1339.456513] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.893651] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.894086] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.022680] env[65511]: INFO networking_nsxv3.common.synchronization [req-0145d85d-02ff-41e8-8d75-fb144adc4860 req-058b2b36-d2e5-47b3-b660-36a123014013 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1345.023358] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1345.023861] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.023995] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.024094] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.024378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.024623] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.024725] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.024791] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.024985] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.025121] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.025256] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.339098] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.339297] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.339415] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.339676] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.339933] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.340097] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.340211] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.340422] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.340581] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.340815] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.340962] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] NeedRegenerationException {{(pid=65511) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.341099] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] no value, waiting for create lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.341211] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] value creation lock acquired {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.341322] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] No value present for key: 'zone-id' {{(pid=65511) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.341425] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Calling creation function for not-yet-present value {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.341563] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.392686] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.392872] env[65511]: DEBUG dogpile.cache.region [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=65511) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1345.392972] env[65511]: DEBUG dogpile.lock [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Released creation lock {{(pid=65511) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.393171] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "network-183" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.393550] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock port-53fee858-8e99-4667-8a7c-52143c392c5b taken with stack trace [, , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.393727] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.393842] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.394199] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.394335] env[65511]: DEBUG networking_nsxv3.api.rpc [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53fee858-8e99-4667-8a7c-52143c392c5b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.527357] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.896657] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.896905] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.896987] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.897228] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.897379] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.897531] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Segment Port 53fee858-8e99-4667-8a7c-52143c392c5b not found, creating... [ 1345.897783] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.897936] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.898063] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.898283] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.898414] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.898689] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.898838] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.898951] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.899174] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.899303] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.899436] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Resource: SegmentPort with ID: 53fee858-8e99-4667-8a7c-52143c392c5b is going to be created. [ 1345.927408] env[65511]: DEBUG networking_nsxv3.common.locking [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.927655] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.927710] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.927977] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.928217] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.928434] env[65511]: DEBUG oslo_concurrency.lockutils [None req-1305c211-ec87-4536-9e73-e6d9310e4622 None None] Releasing lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.030411] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.533254] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.533580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.533580] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.533753] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.533820] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.533909] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1346.565307] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.565498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.565498] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.565716] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.565862] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.579879] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1346.592636] env[65511]: INFO networking_nsxv3.common.synchronization [req-0145d85d-02ff-41e8-8d75-fb144adc4860 req-74600d1b-0d10-4486-98b1-ba2b0cb8d077 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1346.592813] env[65511]: INFO networking_nsxv3.common.synchronization [req-0145d85d-02ff-41e8-8d75-fb144adc4860 req-74600d1b-0d10-4486-98b1-ba2b0cb8d077 service nova] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1346.592950] env[65511]: INFO networking_nsxv3.common.synchronization [req-0145d85d-02ff-41e8-8d75-fb144adc4860 req-74600d1b-0d10-4486-98b1-ba2b0cb8d077 service nova] Enqueued Resource ID: 53fee858-8e99-4667-8a7c-52143c392c5b with Priority: HIGHEST for action port [ 1346.593517] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_rules [ 1346.593650] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1346.593746] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53fee858-8e99-4667-8a7c-52143c392c5b with Priority: HIGHEST for action port [ 1346.594031] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.594169] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.594209] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.594455] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.594496] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.595685] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.595812] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.595972] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock port-53fee858-8e99-4667-8a7c-52143c392c5b taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.596095] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.596150] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.596331] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.596407] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53fee858-8e99-4667-8a7c-52143c392c5b',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.098687] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.099187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.099187] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53fee858-8e99-4667-8a7c-52143c392c5b with status ACTIVE [ 1347.099187] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.099334] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.099378] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.099597] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.099687] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.099901] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.100070] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.100147] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.100317] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.100451] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.100581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.100706] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.100781] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.100996] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.101057] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.101233] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53fee858-8e99-4667-8a7c-52143c392c5b is going to be updated. [ 1347.127594] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.127814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.127814] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.127949] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.128103] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.128272] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53fee858-8e99-4667-8a7c-52143c392c5b" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.590023] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1348.590484] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.590546] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.590752] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.590974] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.591108] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.591187] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.591340] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.591420] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.591518] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.094093] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.596235] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.098679] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.098911] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.098965] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.099184] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.099275] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.099376] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1350.134306] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.134520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.134520] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.134695] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.134841] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.144645] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1351.595359] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.595359] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1352.155476] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1352.155672] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.155801] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.156042] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.156248] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.156364] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.156431] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.156579] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.156658] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.156743] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.156834] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.659615] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.660151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.660151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.660151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.660293] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.660356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.660356] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.660528] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.660616] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.660702] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.660849] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.660939] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.661069] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.661262] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.661404] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.661537] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.661649] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.661692] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.661773] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.661834] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.661926] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.164055] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa967685-2731-4317-8bda-67f4fab2547f: rpc.has_security_group_logging(os_id): False [ 1353.181683] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.181951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.181951] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.182132] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.182226] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.182440] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.182539] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.182599] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.182750] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.182828] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.183009] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.183112] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.183173] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.183326] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.183401] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.183581] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.183673] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.183731] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.183869] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.183944] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.184040] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1353.253067] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.253312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.253312] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.253511] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.253645] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.268216] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1355.281836] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1355.281836] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.596920] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.597389] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.377795] env[65511]: INFO networking_nsxv3.common.synchronization [req-e01442ae-c9fd-46b4-9c13-1c36f00918d6 req-0e308261-8399-4c7d-b82d-117dda36fb0a tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1358.378307] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1358.379166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.379166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.379166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.379166] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.379166] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.379529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.379529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.379529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.379529] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.379680] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.882310] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.384889] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.886496] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.886646] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.886723] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.886940] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.887047] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.887152] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1359.915884] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.916090] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.916161] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.916327] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.916508] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.924994] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1361.938138] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1361.938518] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.379473] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.379473] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.665281] env[65511]: INFO networking_nsxv3.common.synchronization [req-9eec7f47-562e-4cee-bf25-edab02023472 req-e2f60ba1-8dde-4fea-aa5d-5f46dc6b75d4 tempest-ServersTestJSON-2087098377 tempest-ServersTestJSON-2087098377-project-member] Enqueued Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1364.666062] env[65511]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa967685-2731-4317-8bda-67f4fab2547f with Priority: HIGHEST for action security_group_members [ 1364.666518] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa967685-2731-4317-8bda-67f4fab2547f taken with stack trace [, , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.666712] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.666822] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.667120] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.667365] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.667516] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.667676] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.667857] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.667994] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.668153] env[65511]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa967685-2731-4317-8bda-67f4fab2547f',) {} {{(pid=65511) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.171876] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.172151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.172151] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.172462] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.172609] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.172820] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.172922] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.172984] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.173154] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.173232] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.173316] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f is going to be updated. [ 1365.202661] env[65511]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65511) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.202884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.202884] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.203062] env[65511]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.203196] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.211367] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 2s [ 1367.222502] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: IN_PROGRESS for 4s [ 1369.233519] env[65511]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa967685-2731-4317-8bda-67f4fab2547f in Status: SUCCESS [ 1369.233856] env[65511]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa967685-2731-4317-8bda-67f4fab2547f deletion is rescheduled due to dependency. [ 1369.233914] env[65511]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa967685-2731-4317-8bda-67f4fab2547f" {{(pid=65511) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.667290] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.667433] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.668811] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.668811] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.669945] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.670338] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.671087] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.671507] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.672638] env[65511]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.673426] env[65511]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0